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ABSTRACT 

Articles related to assessment in the field of 
reading are presented to provide ideas for those studying reading and 
reading assessment. There are two sections to the bibliography: the 
articles themselves and an index. Many of the entries describe 
informal assessments and are intended mainly for classroom use. The 
124 articles are listed in alphabetical order by primary author and 
indexed for the convenience of users. A set of descriptors was 
developed, and each paper was analyzed using the descriptors. A 
listing of the descriptors prefaces the index. Articles cover 
assessment at all grades for research, classroom, or large-scale 
purposes. They describe a number of types of tasks, from enhanced 
multiple-choice items to portfolios, and a number of kinds of 
performance assessments. Scoring is also considered by some articles. 
(SLD) 
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The following articles represent some of the current holdings of the Test Center lending library. Presence 
on the list does not necessarily imply endorsement: rather, articles are listed solely to provide ideas to those 
pursuing these topics. Many of the entries are informal assessments and are intended mainly for classroom 
use. 

There are two sections to the bibliography the articles themselves in alphabetical order by primary author, 
and an index. The index helps the user find relevant references. In order to make articles easier for users 
to find, a set of descriptors was developed, each paper w as analyzed using this set of descriptors, and an 
index using the descriptors is provided. A complete listing of all descriptors used (with a brief definition of 
the descriptor) prefaces the index. 

In the states of Alaska, Idaho, Montana. Oregon and Washington, these articles may be borrowed free of 
charge on a three-week loan from the Test Center. Users in other states are charged a handling fee. The 
shelf number for each item is listed at the end of the article; for example, TC# 123.4ABCDEF. For more 
information, please contact Matthew Whitaker. Test Center Clerk. (503) 275-9582 or use e-mail: 
testcenter a nwrel org for more information. 



Allen, Barbara, Orange County LEP Assessment Task Force—Sample Packet, February 
1994. Available from: Orange County Department of Education, Instructional 
Services, Curriculum and Instructional Programs, 200 Kalmus Dr., Costa Mesa, 
CA 92626,(714)966-4423. 

This packet contains examples of assessment tasks that have been designed especially for 
students who are limited-English proficient (LEP). 

Teachers specified four major outcomes for LEP students: develop communication skills; 
develop life skills in problem solving, critical thinking, decision making, and self-directed 
learning; improve collaboration; and understand and value cross-cultural tolerance. The 
packet includes assessment tasks and scoring guides for each outcome. Tasks include 
interviews, group work, portfolios, on-demand performance assessment, and projects. 
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Performance criteria are general and sometimes fairly sketchy. Self-reflection and evaluation 
is emphasized. 

No technical information nor student work is included. 
( TC# 300.3ORACOL) 

Ames, Cheryl K. Self-Reflection: Supporting Students in Evaluating Themselves as 
Readers, 1992. Available from: Beaverton School District, 16550 SW Merlo Rd., 
Beaverton,OR 97006, (503) 591-8000, fax: (503)591-4415. 

The author discusses high school student self-reflection in reading — its importance and how to 
promote it in students. Samples of student self-reflection are included. 

(TC# 440.6SELRES) 

Anderson, Richard C, Elfrieda H. Hiebert, Judith A. Scott, et al. Becoming a Nation of 
Readers: The Report of the Commission on Reading, 1985. Available from: University 
of Illinois Press, PO Box 2774, Station A, Champaign, IL 61820. 

This publication marked the first popularization of research on reading which provided an 
expansion of our view on what reading is and what good readers do. The publication 
summarizes the research on reading and draws implications for reading instruction. 

(TC#440.5BECNAR) 

Arter, Judith A. Integrating Assessment and Instruction, 1994. Available from: Northwest 
Regional Educational Laboratory, 101 SW Main, Suite 500, Portland, OR 97204, (503) 
275-9582, fax (503) 503) 275-9489. 

This paper discusses how, if designed properly, performance assessments can be used as tools 
for learning in the classroom as well as tools for monitoring student progress. 

(TC# 150.6INTASI) 

Arter, Judith A. Performance Criteria: The Heart of the Matter, 1994. Available from: 
Northwest Regional Educational Laboratory, 101 SW Main St., Suite 500, Portland, 
OR 97204, (503) 275-9582, fax (503) 275-9489. 

This paper discusses an important issue that pertains to performance assessment in general — 
the need for clear and well thought-out scoring mechanisms. The paper discusses what 



NWRH.. Januarv 199< 
\'cs\ Center. ( 503) 275-9*82 



I) 



Reading Resources 



performance criteria are, the importance of good quality performance criteria, how to develop 
performance criteria, and keys to success. 



(TC# 150.6PERCRH) 



Badger, Elizabeth, and Brenda Thomas. Open-ended questions in reading, December 1992. 
Located in: ERIC Clearinnhouse on Tests, Measurement and Evaluation . Available 
from: American Institutes for Research, 3333 K St., NW, Suite 300, Washington, DC 
20007, (202) 342-5060. Also available from: Massachusetts Department of Education, 
350 Main St., Maiden, MA 02148, (617) 388-3300. 

This short article covers the reasons why "open-ended" questions should not simply be 
multiple-choice items without options, and how new theories about reading and thinking 
require assessment using open-ended questions. The authors believe that in evaluating 
students, we can no longer simply judge whether or not the reader's conclusions are similar to 
the writer's; rather, the quality of the reader's argument or justification for his or her 
interpretation becomes most important. The authors provide some interesting thoughts on the 
types of things we should assess. 

(TC# 440.6OPEQLR) 



Barton, James, and Angelo Collins. Portfolios in Teacher Education. Located in: Journal 
of Teacher Education 44, May- June 1993, pp. 200-210. 

The authors describe the use of portfolios for undergraduate literature and graduate science 
teacher-education students. The authors discuss the rationale for use of portfolios, the 
portfolio process, key questions, and specific application to literature and science. Among the 
points they make are. 

1 . The purposes include: (a) the need to model new instructional strategies if we expect 
students to subsequently use them in their classrooms when they become teachers, and 
(b) the need to match goals for students in higher education classes to appropriate 
assessment — "As a program changes, so must the ways that success in meeting the 
program's objectives are measured. The rapidly evolving role of reading specialists 
demands change in the evaluation of professional competence." 

2 The key steps in developing a portfolio system which works is that the purpose for the 
portfolio has to be clearly established at the beginning (e.g., one goal or purpose in literacy 
is that "the student will integrate theory and practice so that he or she can create their own 
thematically based literature lessons"); evidence is then compiled to show that the student 
has successfully accomplished the purpose of the portfolio; and, finally, the portfolio is 
evaluated using the question, "Am I convinced that the student has met or made progress 
toward the stated goal 9 " 
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No samples of student work or technical information are included. Criteria for portfolios are 
discussed. 

(TC# 130.4PORTEE) 

Bean, Thomas. Organizing and Retaining Information by Thinking Like an Author. 

Located in: Susan Mandel Glazer, Lyndon W. Searfoss, and Lance M. Gentile (Eds.)* 
Reexamining Reading Diagnosis, New Trends and Procedures , 1988, pp. 103-127. 
Available from: International Reading Association, 800 Barksdale Rd M PO Box 8139, 
Newark, DE 19714, (302) 731-1600. 

The author presents recent thinking about the role of text structure in reading comprehension, 
and describes a process for observing, assessing, and improving students' understanding of 
text structure. The author describes various types of text structures in narrative and 
expository writing, and reviews the research on how people use text structure to aid 
comprehension and recall. 

The assessment procedure consists of having students place the paragraphs in a narrative or 
expository passage in the right order, thinking aloud as they do so. The author presents 
several examples which illustrate what to look for in the "think alouds" in order to determine 
knowledge and use of text structure. 

The author finishes by describing two techniques to teach students how to analyze and use 
text structure. 

(TC# 440.6ORGREI) 

Belli ngh am Public Schools. Primary Performance Portfolio, Grades K, 1, 2 and Intermediate 
Performance Portfolio, Grades 3, 4> 5, 1992. Available from: Bellingham Public 
Schools, Box 878, Bellingham, WA 98227, (206) 676-6400, fax (206) 676-2793. 

This document is an outline of suggestions for implementing portfolios for grades 1-5. 
Included are: 

• A list of essential learnings in each grade level combined with suggestions for the type of 
information that could be included as evidence of progress on each goal. For example, a 
student goal in grades 3-5 is "literature competency " Portfolios could include response 
logs, performance or project scoring rubrics, or strategies checklists as evidence of 
attainment of this goal. 

• Checklists and scoring guides for some of the skills. For example, fairly nice 

developmental continuums for reading, science, social studies, art, writing and mathematics 
are included, each having six levels (pre, emergent, beginner, developing, capable, and 
experienced) These are incorporated into a report card 
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Also included are some materials for two units: history and energy. It is not clear how this 
material is used nor why it is included. 

No technical information nor samples of student work are included. 
(TC# 000.3BELPUS) 

Bembridge, Teri. A MAP for Reading Assessment Located in: Educational Leadership 49, 
May 1992, pp. 80-82. 

This article talks about a group of teachers who wanted to improve the way reading is 
assessed in second- and third-grade classrooms. They couldn't find published instruments that 
satisfied them so they built their own. The result, the Multi-Layered Assessment Package 
(MAP), has two parts: listening to the student read aloud and retelling. Three scores are 
generated: word accuracy, sentence comprehension, and retelling. Regular grade-appropriate 
narrative stories are used. The MAP is used by these teachers for accountability and planning 
instruction. 

The procedure is used in the elementary grades. No technical information, scoring forms, or 
sample student responses are included in this document. 

(TC# 440.3MAPREA) 

Bishop, David. On Curriculum Alignment, Anacondas, and Reading Assessment. Located 
in: Kentucky English Bulletin 39, 1990, pp. 58-66. 

In this paper the author reviews some of the problems with using norm-referenced, multiple- 
choice tests to measure student progress in reading, and then describes a possible portfolio 
approach for grades K-6. A very useful part of the paper is a description of what the author 
feels the portfolio should show about students. There are six key areas: fluency (ease with 
reading, volume of reading, frequency of reading), power (norm- and criterion-referenced test 
scores), growth (changes in skill, affect and independence), range (diversity of reading, 
reading in other subject areas), depth (depth of understanding of individual readings and a 
focal point for reading), and reflection (self-reflection and reflection on the writing of others). 

(TC# 440.3ONCURA) 
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British Columbia Ministry of Education. Performance Assessment: Primary, Early, Late, 
Intermediate, and Graduate. Draft, August 1992. Available from: British Columbia 
Ministry of Education, Assessment Branch, Parliament Buildings, 
Victoria, BC V8V 2M4, Canada, (604) 387-4611, fax (604) 356-2504. 

This Macintosh disk contains a host of performance assessments developed by the British 
Columbia Ministry' of Education for all grade levels and subject matter areas. 

(TC# 0003BCPERA) 



Brown, Carol and Susan Lytle. Merging Assessment and Instruction: Protocols in the 
Classroom. Located in: Susan Mandel Glazer, Lyndon W. Searfoss, and Lance ML 
Gentile (Eds.)> Reexaminine Reading Diagnosis, New Trends and Procedures , 1988, 
pp. 94-102. Available from: International Reading Association, 800 Barksdale Rd., 
PO Box 8139, Newark, DE 19714, (302) 731-1600. 

The authors maintain that "think aloud reading protocols" provide a means for gathering 
information about individual readers' ongoing thinking processes and metacognitive behavior. 
A think aloud reading protocol is a verbal or written record of what students think about 
while they read. 

The authors suggest several means to use during regular instruction to elicit these types of 
verbalizations. (In fact, making these verbalizations conscious is a major focus of instruction 
for the authors.) They also describe a coding scheme for these verbalizations. 

The paper does not, however, provide any guidance on either what kinds (or mix) of 
verbalizations students should be making, or what to do if the teacher notices gaps in 
verbalization. The goal seems to be merely to get students to verbalize, think about these 
verbalizations, and compare these verbalizations with others. 

(TC# 440.6MERASI) 



Calfee, Robert, and Elfrieda Hiebert. The Teacher's Role in Using Assessment to Improve 
Learning. Located in: Assessment in the Service of Learning. Invitational Conference 
Proceedings , 1988, pp. 45-61. Available from: Educational Testing Service, Rosedale 
Rd., Princeton, NJ 08541, (609) 734-5686. 

The authors believe that the knowledgeable teacher plays a critical role in valid classroom 
assessment, and that effective instruction requires informed professional judgment. Although 
a general argument, the authors' specific examples come from the area of litt .y. They 
contend that literacy needs in previous times were far more simple than what will be required 
in the future. Thus, while the past skills-based, decoding approach might have been adequate 
for a previous age, in today's world literacy means people who are in total control of language 
and are able to think critically about what they read. Reading skill must provide the basis for 
pursuing all other subjects. 
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The authors develop this theme in more detail contrasting past teacher education, reading 
instruction, and student assessment procedures to what is needed today. 

(TC# 440.6TEAROU) 

Calfee, Robert C, and Pam Perfumo, Student Portfolios: Opportunities for a Revolution in 
Assessment Located in: Journal of Reading 36, April 1993, pp. 532-537, 

The authors report on a survey of teachers to determine actual practice with respect to 
reading and writing portfolios. They surveyed 150 selected teachers, and held a two-day 
conference for 24 of them. Results showed that teachers: 

1 . Believe that they are more in charge of their instructional programs by using portfolios 

2. Describe many benefits for students which result when they responsibility and select their 
own work for portfolios 

3. Do not attend to technical aspects of portfolios such as reliability and validity 

4. Have no systematic way of analyzing, scoring, or grading portfolios 

The authors are very optimistic about the possibility of portfolios reforming education. 
(TC# 440.6STUPOO) 

California Assessment Program, A Sampler of English-Language Arts Assessment — 
Elementary (Reading); Preliminary Edition, 1992, Available from: California State 
Department of Education, Publications Sales, PO Box 271, Sacramento, CA 95812, 
(800) 995-4099, 

California is developing a series of assessments in grades 4/5, 8, and 10 to assess reading, 
writing, language arts, science, math, and social studies. These are combinations of multiple- 
choice and constructed response. This document is a released exercise for the elementary 
reading test. 

Tasks require students to read lengthy passages of between three and five pages. While they 
read they have space to write down "thoughts, feelings, and questions" about what they are 
reading. There is a series of questions that ask students to express their feelings about what 
happens in the story, select lines from the story that "make them think" and tell why those 
lines were selected, speculate on the feelings and motivations of characters, tell what might 
happen next and explain why, and write anything else they want. 
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Responses are scored on a six-point holistic scale that emphasizes insight, connections, risk- 
taking and challenging the text. Sample student responses are included. No technical 
information is included. 



(TC# 440.3SAMENLr) 



California Department of Education. California Learning Record — Handbook for Teachers, 
and Handbook for Teachers, 6-12, Preview Edition, 1993. Available from: UCSD 
Bookstore, University of California (3) San Diego, 9500 Gilman Dr., La Jolla, CA 
92093, (619) 534-4430. 

The California Learning Record (CLR) yields a portfolio of information about a student's 
annual language and literacy progress in K-12 classrooms. Progress is based on observation, 
anecdotal records, and consultations with parents and students themselves. As students 
mature, they take on responsibility for providing evidence of their learning. Pilot tested by 
California teachers since 1988, the CLR is an adaptation of the Primary Language Record, 
developed at the Centre for Language in Primary Education in London, England. A major 
California contribution is the extension of the record of achievement to middle and secondary 
schools, using the base of literacy development to support students' academic progress in all 
subject areas. 

The CLR Handbooks for Teachers, K-6 and 6-12 provide rationale, descriptions and examples 
of how the CLR works. Included with each handbook are master copies of the CLR summary 
and data collection forms. Not included are technical information nor criteria for judging 
progress. 

(TC# 400.3CALLER2) 



CaSifornia Department of Education. Students Standards and Success — The California 
Learning Assessment System — Communications Assistance Packet, 1993. Available 
from: California State Department of Education, Publications Sales, PO Box 271, 
Sacramento, CA 95812, (800) 995-4099. 

The purpose of this document is to introduce the California Learning Assessment System 
(CLAS) to the public. CLAS is given at grades 4, 8, and 10 in reading, writing, and 
mathematics, and at grades 5, 8, and 10 in science and social studies. There are both end-of- 
year tests and a portfolio component. CLAS is designed to give information on individual 
students, is tied to state standards, and is performance based. 

The document includes letters to parents, answers to frequently asked questions, sample press 
releases, sample meeting agendas, information on the assessments, resources, and sample 
items with student responses. 

The math scoring guide is a four-point, holistic rubric emphasizing conceptual understanding 
and clear communication. The reading scoring guide is a six-point holistic scale, focusing on 
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constructing meaning, developing connections, taking risks, and challenging the text. The 
writing scoring guide is a six-point holistic scale emphasizing organization, coherence, 
elaboration, relevance of arguments, and awareness of style and sentence variety. 



(TC# 000.6STI STS) 



Clark, Charles H. Assessing Free Recall. Located in: The Reading Teacher 35, January 
1982, pp. 434-439. 

This document describes a procedure for assessing how much of a passage a student 
remembers and the relative importance of what is remembered. The teacher breaks a passage 
into pausal units and assigns an importance number to each unit. After the student reads the 
passage silently, he or she retells everything he or she remembers. The teacher indicates the 
sequence of recall on a worksheet and analyzes the amount recalled, the sequence of recall, 
and the level of importance of the recalled material. 



(TC# 440.3ASSFRR) 



Clay, Marie ML Concepts About Print Located in; The Early Detection of Reading 

DiiT^ ilties , 1985. Available from: Heinemann Educational Books, Inc., 361 Hanover 
St., Portsmouth, NH 03801, (603) 431-7894. 

Concepts About Print is a diagnostic procedure that the author presents as part of a longer 
book about reading in the early grades. The procedure requires the student to respond to 24 
questions and tasks surrounding books, such as: "Show me the front of this book/ and "Point 
to it while I read it." Questions and tasks cover parts of the book, how a story is organized, 
how words are arranged on a page, word/print correspondence, which page is read first, 
meaning of punctuation, capital and lower case correspondence, etc. The procedure refers to 
two stories which are not included in the document. 

The author states that this procedure is a "sensitive indicator of one group of behaviors which 
support reading acquisition." Concepts About Print has been translated and used with Danish 
and Spanish-speaking children. 

The author also presents another list of behaviors to observe while going through Concepts 
About Print to look at effectiveness of strategies. 



There is no technical information included. 



(TC# 440.3CONABP) 



ERIC 



NWRI-L. Junuan. W5 *> *- r } Heading Resources 

Test Center, ( «0.i ) 275-95X2 ! U 



Clemmons, Joan, Lois Laase, DonnaLynn Cooper, et ah Portfolios in the Classroom: A 
Teacher's Sourcebook, 1993. Available from: Scholastic Professional Books, 
Scholastic Inc., 2931 E. McCarty St, Jefferson City, MO 65102. 

This booklet describes one elementary school's portfolio system for documenting student 
growth in reading and writing. The system includes emphasis on student control, self 
evaluation, and goal setting. The authors: 

• articulate well that the goal of portfolios is to allow students to take control of learning 

• describe the kinds of classrooms in which portfolios are most likely to be successful 

• outline a step-by-step plan for getting started and involving parents 

• describe a procedure for teaching self-evaluation and goals-setting skills 

• help with student-teacher portfolio conferences 

• include complete portfolios for a second- and fifth-grade student 

• include an appendix of reproducible letters, questionnaires, forms, and charts 
(TC# 400.3PORCLT) 

Coalition of Essential Schools. [ Various Articles on Exhibitions of Mastery and Setting 
Standards], 1982-1992. Available from: Coalition of Essential Schools, Brown 
University, Box 1969, One Davol Sq., Providence, RI 02912, (401) 863-3384. 

Although not strictly about reading, this series of articles discusses performance assessment 
topics and goals for students that are relevant. The articles are: Rethinking Standards ; 
Performances and Exhibitions: The Demonstration of Mastery ; Exhibitions: Facing 
Outward, Pointing Inward ; Steps in Planning Backwards ; Anatomy of an Exhibition : and The 
Process o f Planning Backwards . 

These articles touch on the following topics: good assessment tasks to give students, the need 
for good performance criteria, the need to have clear targets for students that are then 
translated into instruction and assessment, definition and examples of performance 
assessment, brief descriptions of some cross-disciplinary tasks, the value in planning 
performance assessments, and the notion of planning backwards (creating a vision for a high 
school graduate, taking stock of current efforts to fulfill this vision, and then planning 
backward throughout K-12 to make sure that we are getting students ready from the start). 

(TO 150.6VARARD) 
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CTB/McGraw-Hill. Performance Assessment Task Bank, Reading and Language, Grade J, 
1993. Available from: CTB/McG raw- Hill, PO Box 150, Monterey, CA 93942, 
(800) 538-9547. 



The CTB reading and language task bank is a compendium of 29 tasks (containing 366 
separate activities) for grades 3-9 that can be used by districts to design their own 
performance assessments. Local educators can select from various purposes, activity lengths, 
student response modes, pre-task activities, skills covered, type of materials and equipment, 
and task complexity. Each task has been pilot tested and comes with scoring directions. 
Support software is available. 

The material we obtained contains a general overview of the system and one complete third- 
grade reading task. Students read two intact passages and answer a variety of integrative and 
reflective questions. The scoring guide was not included. 

(TC# 400.3CTBREL) 

Darling-Hammond, Linda, Lynne Einbender, Frederick Frelow, et al. Authentic 

Assessment in Practice: A Collection of Portfolios, Performance Tasks, Exhibitions, and 
Documentation, October 1993. Available from: National Center for Restructuring 
Education, Schools, and Teaching (NCREST), Box 110, Teachers College, Columbia 
University, New York, NY 10027. 

This book contains sample performance assessments from a number of sources for grades 1- 
12 in science, math, social studies, writing and drama. Formats include exhibitions, projects, 
on-demand performance assessments, and portfolios. The authors have included reprints of 
papers that discuss characteristics of "authentic" assessment, performance task design, and 
portfolios. Not all assessment information is reproduced; usually the authors have excerpted 
or summarized information. Performance tasks are more thoroughly covered than 
performance criteria. In most cases, no technical information or sample student responses are 
provided. 

(TC# 000.3AUTASP) 

DeFabio, Roseanne. Characteristics of Student Performance as Factors in Portfolio 

Assessment, 1993. Available from: National Research Center on Literature Teaching 
and Learning, University at Albany, State University of New York, 1400 Washington 
Ave., Albany, NY 12222. 

The author describes a framework for describing what students are able to do in the study of 
literature and what to look for in portfolios to assess student learning in literature. These 
could be considered criteria for assessing a literature portfolio. The factors are: range. 
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flexibility, connections, conventions, and independence. No grade levels are mentioned, but it 
appears to be most appropriate for grades four and above. 

(TC# 400.3CHASTP) 

Dole, Janice, Gerald Duffy, Laura Roeher, et aL Moving From the Old to the New: 

Research on Reading Comprehension Instruction. Located in: Review of Educational 
Research 61, Summer 1991, pp. 239-264, 

Although not specifically about assessment instruments in reading, this article provides a good 
overview of current cognitive research on reading. The article is included here because, in 
order to wisely choose assessment instruments, one needs a clear idea of the target to be 
assessed 

The article clearly describes the view that reading comprehension is constructive; readers use 
their existing knowledge and a range of cues from the text and the situational context in which 
the reading occurs to build, or construct, a model of meaning from the text. This developing 
view of the reading process is contrasted with the view underlying past instructional practices. 
The authors then outline what a reading curriculum would look like that is based on a 
cognitive view of the reading process. 

(TC# 440.6MOVFRO) 

Eberhart, Carol, and John Hoftstrand. Secondary Project Assessment: Building 

Meaningful Measures of Change, 1993. Available from: Ilahee Junior High School, 
36001 1st Ave. S, Federal Way, WA 98003, (206) 927-3073. 

This document is a series of handouts used at a conference. They include information about, 
and examples of, the interdisciplinary project guidelines used for looking at ninth-grade 
student mastery of skills, knowledge, and abilities. The materials include purposes for such 
exhibitions of mastery, an exhibition planning guide for students, eight project specifications 
(including performance criteria), an exhibition worksheet for use by students, and a schedule 
for students to present their projects to teams of raters (including community members). 

Students can develop a project in one of eight prespecified areas (community service, 
controversial issue, decorating a home, expressing an emotion, fir ling a job. fitness challenge, 
planning a city, and cultural exchange) or one proposed by the student. Projects are judged by 
means of "mix and match" performance criteria — depending on the project, performance will 
be assessed on some combination of eight dimensions of performance (corresponding to major 
outcomes for students): perceptive problem finders, effective and confident communicators, 
healthy people, collaborative workers, self-directed learners, responsible citizens, culturally 
aware individuals, and creative producers). The project is included on this bibliography 
because some of the dimensions of performance relate to analyzing and interpreting print 
material 
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No sample student work or technical information is included. 



(TC# (MMUSECPRA) 



Eeds, Maryann* Holistic Assessment of Coding Ability. Located in: Susan Mandel Glazer, 
Lyndon W. Searfoss, and Lance M. Gentile (Eds*), Reexamining Reading Diagnosis: 
New Trends and Procedures , 1988, pp. 48-66. Available from: International Reading 
Association, 800 Barksdale Rd„ PO Box 8139, Newark, DE 19714, (302) 731-1600. 

The author focuses on the "coding" aspect of reading (i.e., the relationship between sounds 
and symbols). However, she emphasizes that mere mastery of the code will not solve all 
reading problems; there must be both a code and a language emphasis (. cr/ ntax, semantics, and 
the context in which reading occurs) for successful literacy programs. After establishing this 
point, she goes on to outline how knowledge of the code develops, and discusses some 
informal diagnostic procedures to discover where children are in the process of breaking the 
code. She suggests three categories of procedures: careful observance of children's writing, 
close attention to what students say regarding their discoveries about print as they learn to 
write, and qualitative consideration of their miscues as they read whole text. 

Specifically, the author shows how the following ideas allow one to assess students' mastery 
of the coding system: 

1 . Concepts about print assess students 1 knowledge of what print is and does The author 
includes a summary of nine tasks for students to perform in order to assess this ability. 

2. Examination of writing can give hints as to the students' understanding of directionality, 
letters, etc. The author describes in some detail how the examination of spelling (or 
invented spelling) can provide information about development, and includes a detailed 
developmental framework with four stages. 

3. Miscues during oral reading can help determine what clues students use to create 
meaning — syntactic, semantic, etc. 

(TC# 440.3HOLASC) 



Eggleton, Jill. IWiole Language Evaluation: Reading, Writing and Spellings 1990, 
Available from: The Wright Group, 18916 N. Creek Pkwy., Bothell, WA 98011. 

The author ties three stages of development in reading, writing, and spelling to instruction and 
provides many samples of ways to assess them in order to determine stage and skill 
attainment: rating scales, checklists, and anecdotal records. She also briefly discusses self- 
reflection. 

Two books (grades K-3 and 4-6) are designed for informal classroom use. Each subject and 
developmental level contains sections entitled: teacher goals (instructional idear), student 



eric 



SWRI-L January 199< 13 ^ Reading Resources 

IVM Center. (503)275-95X2 



goals (things for students to accomplish), assessment/monitoring techniques, and reporting 
progress 



The instructional activities are good but, because of a lack of complete definitions for items on 
checklists, the author assumes a certain amount of expertise on the part of users about 
reading, writing, and spelling. Samples of student work, provided to illustrate the 
developmental stages, are mostly only given in writing. No technical information is available. 

(TC# 400.3WHOLAR) 

Fagan, William T., Julie M. Jensen, and Charles R. Cooper. Measures for Research and 
Evaluation in the English Language Arts y 2 y 1985. Available from: National Council of 
Teachers of English, 1111 Kenyon Rd., Urbana, IL 61801, (217) 328-3870. Also 
available from ERIC: ED 255 933. 

This book contains a number of scoring guides for assessing various targets in reading, 
literature, writing and oral communication. 

(TC# 430.1MEAREE2) 

Farr, Roger. Putting It All Together: Solving the Reading Assessment Puzzle. Located in: 
The Reading Teacher 46, September 1992, pp. 26-37. 

The author discusses the following topics: ( 1) the reasons for a recent increase in the amount 
of reading assessment (accountability demands and attempts to find alternatives to traditional 
testing); (2) what to consider when developing an assessment plan in reading (purposes, the 
informational needs of various audiences); (3) current reading theory and its relationship to 
types of assessment; and (4) recommendations for how to put it all together. 

The major thrust of the paper is that various audiences have different informational needs and 
no single assessment is likely to satisfy all of them. We need to be sympathetic to each other's 
informational needs and plan an assessment program that is varied. The author suggests that 
norm-referenced tests, performance assessments and portfolios are all useful components of 
such a system. There is a very nice summary of essential features of reading portfolios. 

The author concludes by saying, "The assessment puzzle can be solved. The solution, 
however, is not as simple as identifying a nonexistent test that will do the whole job nor as 
arbitrary as eliminating most reading assessment. Rather it takes a vision that focuses on what 
real literacy means and the awareness that various groups have a stake in helping students to 
develop as literate citizens. Such a vision must not use assessment to isolate. It must respect 
the complex nature of literacy, it must serve students and help them to become reflective self- 
assessors, and it must create links that bring instruction and assessment together." 

(TC# 440.6PUTALT) 
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Fari% Roger, and Robert F. Carey. Reading: What Can Be Measured?, 1986. Available 
from: International Reading Association, 800 Barksdale Rd., PO Box 8139, Newark, 
DE 19714,(302) 731-1600. 



This book is an anthology of articles concerning issues surrounding the assessment of reading, 
guidelines for the improved use of reading tests, trends in assessing reading, and various ways 
to assess reading comprehension, word recognition, vocabulary, study skills, and reading rate. 

This book is more a review of issues and procedures than detailed instruction in how to assess 
using a given approach. 

(TC# 440.6REAWHC) 

Farr, Roger, and Beverly Farr. Integrated Assessment System — Language Arts Performance 
Assessment, 1990. Available from: The Psychological Corporation, Harcourt Brace 
Jovanovich, Inc., 555 Academic Ct., San Antonio, TX 78204, (800) 228-0752. 

The Integrated Assessment System (IAS) for grades 1-8 (in reading, writing, science, and 
math) is one of two performance-based assessment supplements to the Metropolitan 
Achievement Test (MAT7) and Stanford Achievement Test (SAT8). The other is GOALS 
which requires short responses on tasks that are similar to multiple-choice tests. 

The Integrated Assessment System requires more extended responses. The IAS consists of 
three reading booklets for each grade level that reflect a variety of text types and topics, and a 
guided writing activity that leads to a written product based on the reading. The writing 
activities include story endings, persuasive essays, reports, historical fiction, letters, and 
brochures. One primary task, for example, has students write a letter to "Turtle," the main 
character in one of the stories, to help him decide what to do about a new house. Writing is 
assessed using a three-trait system — response to reading (the amount and accuracy of 
information from the reading), management of content (organization and development), and 
command of language (word choice, sentence structure, grammar, and mechanics). The 
writing activities encourage process writing including collaboration. 

A general scoring guide is adapted for each task to create a task-specific guide. Complete 
technical information, including norms, is available. 

(TC# 400.3LANARP) 

Fingeret, Hanna Arlene. It Belongs To Me: A Guide to Portfolio Assessment in Adult 
Education Programs, 1993. Available from: Literacy South, Snow Bldg., 
331 W. Main St., Durham, NC 27701, (919) 682-8108. 

This is a short paper on the use of portfolios in adult literacy programs, based on intcviews 
by the author with a number of programs developing this concept. Although the paper states 
that it emphasizes assessment portfolios (showcase, presentation), their actual steps for 
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implementation also imply their use as an instructional tool. For example, the first step is 
"clarify your beliefs about literacy and their relationship to how you work with students." 
Some assistance with student self-reflection is also provided. 

Not included are samples of student work, criteria, or technical information 

(TC# 440.3ITBELM) 

Flood, James, and Diane Lapp. Reporting Reading Progress: A Comparison Portfolio for 
Parents. Located in: The Readin2 Teacher March 1989, pp. 508-514. 

This article describes the content of a reading (and writing) portfolio in the elementary grades 
that can be used to show student progress to parents. 

(TC# 400.3REPREP) 

Fredericks, Anthony, and Timothy Rasinski. Involving Parents in the Assessment Process. 
Located in: The Reading Teacher 44, 1990, pp. 346-349. 

The authors maintain that parents should be invited to participate in all aspects of the 
classroom reading program. This enables parents to understand the complexity of the reading 
process and reading instruction, observe growth more directly and understand what they can 
do to help. The authors suggest several ways to get parents involved. Examples are: 

1 . Early in the school year, provide a means for parents to state individual expectations for 
their child. 

2. Develop simple question sheets for parents to use to assess reading progress. (Two such 
sheets are included in the article.) 

3. Frequently ask parents to compose lists of things their children have learned in reading. 
(TC# 440.3INVPAA) 

Gahagan, Hilary Sumner, Dewayne Smith, and Shelley King. Project P.RI.D.E. Available 
from: Beaverton School District, PO Box 200, Beaverton, OR 97075, (503) 591-8000, 
fax: (503)591-4415. 

This document is a set of handouts from a conference presentation. They are very readable 
and present a good overview of Project P.R.I.D.E. — an inclusion program for special 
education students that utilizes language arts portfolios to document student progress and 
communication with parents It also encourages students to take control of learning. The 
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handouts include a description of the portfolio system, a form for student self-evaluation of 
their portfolios, a feedback questionnaire for parents, and daily schedules. 

(TC# 400.3PROPRI) 

Gillet. Jean, and Charles Temple. Understanding Reading Problems: Assessment and 
Instruction. Third Edition, 1990. Available from: Harper-Collins Publishers, 
1000 Keystone Industrial Park, Scranton, PA 18512, (800) 242-7737. 

This book starts by describing (1) how literacy develops and the types of things students need 
to know and be able to do in order to learn to be literate, and (2) the types of problems 
students run into that hinder their learning to be proficient. Then the authors systematically 
describe various assessment techniques to determine whether students have the prerequisite 
knowledge for learning to read or to determine the nature of the reading problems they are 
having. There is an especially good discussion of development, concepts about print, and 
miscue analysis. The strength of this book is that the authors describe what needs to be 
known, why it needs to be known, and how to get the information. They also provide the "so 
what" — instructional strategies for various kinds of problems. 

The only weakness might be in the lack of a statement of the ultimate target of reading 
instruction — what do we ultimately want readers to be like? What is an expert reader? 
Because of this lack of a concrete statement, we are left to infer the target from the 
assessment devices and instructional methods discussed. It is more difficult to see how it all 
fits together, and some aspects of good reading may be under-emphasized, for example, 
metacognition and attitudes. 

(TC# 440.6UNDRPR) 

Glazer, Susan Man del, L/W. Searfoss, and L.ML Gentile. Reexamining Reading Diagnosis: 
New Trends and Procedures, 1988, Available from: International Reading Association, 
800 Barksdale Rd., PO Box 8139, Newark, DE 19714, (302) 731-1600. 

This book is a compendium of articles covering a variety of topics. This reviewer found the 
following of most use: using student "think alouds" to analyze reading strategies and self- 
monitoring (p. 94); checklists for developmental stages in early reading and writing that can 
be used to analyze student progress (p. 48), informally monitoring student knowledge of text 
structures (p. 103); and a checklist for analyzing student retelling of stories (p. 139). 

(TC# 440.6REARED) 
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Glazer, Susan Mandel and Carol Smullen Brown* Portfolios and Beyond: Collaborative 
Assessment in Reading and Writings 1993. Available from: Christopher-Gordon 
Publishers, Inc., 480 Washington St., Norwood, MA 02062, (617) 762-5577. 

The authors of this book state their purpose, as being to elucidate assessment procedures that 
parallel and support a more holistic approach to language arts instruction. The book has some 
good ideas on the following topics. 

1 . The type of classroom environment that is necessary to support this instructional model: a 
student-centered environment that allows students to read and write for real reasons, 
develop a community of learners, be comfortable taking risks, and share control of learning. 

2. A self-assessment checklist for evaluating a "literacy environment" that focuses on suppiies 
and room arrangement. It does not include instructional approaches, although there is a 
section on how to manage a "student-centered" classroom. 

3. Information to help students self-reflect, self-assess, and control their own learning, 
including self-evaluation checklists and open-ended questions. 

4. The need for ways to more formally summarize and report progress. There are chapters on 
writing and reading. The writing chapter has progress summary forms and developmental 
continuums; the reading chapters cover think-alouds and retelling. There is also help with 
how to do them and what to look for in student responses. (This is frequently left out of 
whole-language books.) 

5. Information to help interact with parents 

6. Practical help with finding time, storing work, etc. 

Lots of student work is included. Technical information is not included. 
(TC# 400.6PORBEY) 

Goodman, Kenneth, Lois Bridges Bird, and Yetta Goodman. The Whole Language Catalog 
Supplement on Authentic Assessment, 1992. Available from: American School 
Publishers, 1221 Farmers Ln., Suite C, Santa Rosa, CA 95405, (800) 882-2502. 

This oversized publication is a compendium of case studies, philosophy statements, and 
examples of assessment ideas for use by teachers to look at student progress in reading, 
writing, spelling, and oral language. Although the major chapters focus on philosophy, the 
teacher as a professional, student self-evaluation, assessment methods, and specific assessment 
ideas, the organization is inductive — the many vignettes and samples are intended to provide 
ideas to knowledgeable teachers. 

There are especially good sections on miscue analysis (what it is, how to do it, and many 
student samples), the philosophy of whole language, the teacher as constructor of meaning, 
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and ideas for student self reflection and evaluation. It also has lots of sample report cards, 
good ideas for evaluating a literate environment and parent involvement. One strength is that 
it doesn't just list information collection techniques, but also outlines the sorts of things to 
look for in student performance or work to help gauge progress 

If there are weaknesses in this publication it would be, first, that there is no overview of 
targets for students: what does a good reader or writer look like, and how do the various 
suggestions for data collection provide evidence of progress toward these targets? Lots of 
samples and ideas are given but without an organizing principle. (This is why I call the 
publication inductive. One builds the definition of targets from the samples given.) For 
example, one checklist has you note whether students "enjoy working at the writing table." 
You have to both infer why this is important, and take it on faith that this is more important to 
collect than some other indicator. 

Secondly, although lists of things to look for in student performance and work are given, they 
are frequently undefined. For example, one rating form has you note student "use of prior 
knowledge and context to draw conclusions and make predictions." Will anything count 9 
Will teachers be consistent in their judgments? The authors are unclear on these points. 

Thus, this publication is probably most useful for inductive thinkers and already 
knowledgeable teachers who are looking for ideas. 

(TC# 400.6WHOLAC) 

Goodman, Yetta ML, Dorothy J. Watson and Carolyn L. Burke. Reading Miscue 

Inventory — Alternative Procedures, 1987. Available from: Richard C. Owen Publishers, 
Inc., PO Box 585, Katonah, NY 10536, (800) 336-5588, fax: (914) 232-3977. 

Miscue analysis includes a number of procedures to view what readers do when they read in 
order to understand the reading process. It is used to evaluate reading problems, as well as to 
provide information about student reading comprehension, strategies, and background 
knowledge. A miscue is essentially an "error" or "mistake" while reading. A retelling adds 
information about the reader's search for meaning and supports explanations about many of 
the reader's miscues. Results are used to plan instruction. 

This book is a comprehensive discussion of theoretical underpinnings, procedures for miscue 
analysis, and use of results in instruction and student self-assessment. Although the 
procedures are theory and research based, the authors don't provide evidence of impact on 
students. Lots of sample student performances are included. 

(TC# 440.3REAMII) 



NWRK1.. Januarv 1995 
Tost Center. (503)275-9582 



19 



Reading Resources 



Grant, Audrey, Towards a Transactive Theory of the Reading Process and Research in 
Evaluation. Located in: Sue Legg and James Algina (Eds.), Cognitive Assessment of 
Language and Math Outcomes , 1990, pp. 192-240. Available from: Ablex Publishing 
Corp., 355 Chestnut St., Norwood, NJ 07648, 

The author compares previous theories of reading (which she calls "product" theories) with 
current constructionist theories (which she calls "process" theories), and expands the notion of 
process theories to "transactive" theories, in which the meaning a reader brings to the text is 
personal, creative, and colored by past experiences (e.g., the whole context under which 
previous reading experiences occurred). After describing these various theories, the author 
draws seme implications for instruction and assessment. 

Specifically, the author recommends a holistic, ethnographic approach to assessment based on 
day-to-day classroom activities and settings. She also reviews common assessment techniques 
in light of her perspective on the reading process. These reviews include: miscue analysis, 
cloze, ongoing records, informal reading inventories, and individual conference logs. 

(TC# 440.1TOWTRT) 

Ministry of Education and Training [Victoria, Australia]. English Profiles Handbook, 
Assessing and Reporting Students' Progress in English, 199L Available from: 
Touchstone Applied Science Associates, Inc., Fields Ln., PO Box 382, Brewster, NY 
10509, (914) 277-4900, fax (914) 277-3548. 

The English Profiles Handbook describes student proficiency in speaking, reading and writing 
in terms of developmental continua. There are nine bands that describe clusters of behaviors 
from the least to the most sophisticated. For example, writing band "A" denotes such student 
behaviors as: "uses writing implement to make marks on paper," and "comments on signs and 
other symbols in immediate environment." Writing band "I" denotes such behaviors as: 
"writes with ease in both short passages and extended writing," and "extended arguments are 
conveyed through writing." 

The booklet also: (1) provides some guidance on how to make and record observations, 
including the classroom tasks within which teachers might make their observations; and (2) 
discusses how to promote consistency in judgments between teachers (without using technical 
terminology). 

The authors point out the benefits of this approach — the bands direct teachers' attention to 
growth in literacy, they give teachers a common vocabulary for talking about such growth, 
and they allow students and parents to observe growth. 

The handbook is designed for informal classroom use. No technical information is available. 
(TC# 400.3ENGPRH) 
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Hansen, Jane. Literacy Portfolios Emerge. Located in: The Reading Teacher 45, 
April 1992, pp. 604-607. 

The author describes a sixth grade teacher's experience in developing a literacy portfolio for 
her students both the steps needed to build the competencies required by students to pui 
together their own portfolios, and the classroom environment needed to encourage true 
student portfolio development. Some of the skills she had students practice were: discussing 
books, describing the reasons for the book choices they made; conducting a discussion 
without a teacher present; and discussing what, in t^eir reading, still confuses them. 

When students had the necessary skills, they were introduced to the concept of a "literacy 
portfolio" in which they show who they are as readers. This will then later build into "who the 
student wants to be as a reader," which requires additional skills in self-reflection and 
development of criteria. 

(TC# 440.6LITPOE) 

Hansen, Jane, Literacy Portfolios: Helping Students Know Themselves. Located in: 
Educational Leadership 49, 1992, pp. 66-68. Also available from: University of New 
Hampshire, Morrill Hall, Curham, NH 03825. 

The author describes a K-12 project in which students are completely in control of what goes 
into their literacy portfolios, and any rationale is accepted at face value. The idea is to build 
self esteem and to help students get to know who they are as readers. Items from outside of 
school are encouraged. There is also some help in the article with how to get started and how 
to promote self-reflection. 

There is no discussion of criteria, but there are some examples of what students placed in their 
portfolios and why. 

(TC# 400.3LITPOH) 

Hetterscheidt, Judy, Lynn Pott, Kenneth Russell, et ah Using the Computer as a Reading 
Portfolio. Located in: Educational Leadership 49, 1992, p. 73. Also available from: 
Bellerive School, 666 Rue De Fleur, Creve Coeur, MO 63141. 

The authors briefly describe their use of a commercially available Macintosh HyperCard 
system that allows their fifth grade students to scan writing, record themselves reading, give 
self-evaluations, and keep track of comments and other notes. The emphasis is on recording 
progress and allowing for self-reflection — samples are entered at various regular times during 
the school year. 

(TC# 400.3USICOR) 
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Hill, Bonnie Campbell and Cynthia A. Ruptic. Practical Aspects of Authentic Assessment — 
Putting the Pieces Together, 1994. Available from: Christopher-Gordon Publishers, 
Inc., 480 Washington St, Norwood, MA 02062, (617) 762-5577). 

The authors discuss how to assess reading, writing, the content areas, and student attitudes 
using portfolios, anecdotal records, classroom observations, checklists, conference records, 
and developmental continuums. The book mentions involving parents, student self-reflection, 
reporting, and special students in the assessment process. 

Checklists and developmental continuums are included for reading and writing. Some sample 
student work is included, but technical information is not. The information appears to be 
most appropriate for grades K-8. 

(TC# 000.6PRAASA) 

Hug, Jo- Anne. Balanced Assessment for Improved Classroom Instruction and Student 
Learning, September 1993. Available from: Alberta Education, Box 43, 11160 Jasper 
Ave., Edmonton, Alberta, Canada T5K 0L2, (403) 427-0010, fax (403) 422-4200. 

This document is a set of handouts from a conference presentation. It briefly describes all 
three of Alberta's student assessment programs — diploma examinations (high school), 
achievement tering (grades 3, 6, and 9), and diagnostic evaluation (elementary reading and 
math, secondary communication skills). All of these use combinations of multiple choice and 
performance assessment 

Sample third grade reading and writing assessments are included: (1) a list of books for 

students to read; (2) the activities for students to complete as they read the book; 

(3) generalized scoring guides for marking student responses (predictions, story structure, 

retelling main events, characters, personal connections, and opinion; (4) response to reading 

task sheet and scoring guide (content/development, language and conventions); and 

(5) teacher and student experiences and opinion questionnaires. 

No technical information nor sample student responses are included. 

(TC# 40<UBALASi) 

Illinois State Board of Education. Illinois Goal Assessment Program — Reading Tests, 1991. 
Available from: Tom Kerins (Mgr.), Illinois State Board of Education, 100 N. First St., 
Springfield, IL 62777, (217) 782-2221. 

This document contains the 1991 versions of Illinois' grade 3, 6, 8, and 1 1 reading tests. As 
with previous tests, these attempt to incorporate current theories of reading, even though they 
are in multiple-choice format. Features include: students read entire selections rather than 
short passages; students are asked about prior knowledge of the topic; questions are based on 
important concepts in the text; students answer questions about reading strategies; there are 
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attitude questions on some forms; all questions have one to three correct answers; and 
students read two passages — narrative and expository. 



(TC# 440.3ILLGOR2) 



International Reading Association* Portfolios Illuminate the Path for Dynamic, Interactive 
Readers. Located in: Journal of Reading , May 1990, pp. 644-647* 

This paper discusses the importance of classroom assessment in reading and how portfolios 
are one tool for this purpose. The authors present a general overview of what could be 
accomplished with students by doing portfolios, the importance of student self-reflection, and 
how portfolios might be used in the classroom. 



(TC# 440.6PORILP) 



Johnston, Peter Steps Toward a More Naturalistic Approach to the Assessment of the 

Reading Process. Located in: Sue Legg and James Algina (Eds.), Cognitive Assessment 
of Language and Math Outcomes , 1990, pp. 92-143. Available from: Ablex Publishing 
Corp., 355 Chestnut St., Norwood, NJ 07648. 

This chapter presents a rationale and guidelines fcr a more naturalistic approach to reading 
assessment. Such assessment consists of observations of children's skills within the context in 
which they normally occur. The chapter discusses the nature of decision making in education, 
the process of assessment from a naturalistic standpoint, the aspects of reading which should 
be assessed, and a contrast of the naturalistic approach to more traditional assessment 
approaches. 

In order to really be able to implement his ideas, several things must be done, including: 

1 . helping teachers to become sensitive observers and interpreters of children's behavior; the 
teacher is the assessment instrument; 

2. working on clarifying the knowledge and behaviors that are the targets of assessment. 
(TC# 440.6STETOM) 



Kay, Gary. A Thinking Twist on the Multiple-Choice Question. Located in: Journal of 
Reading 36, 1992, pp. 56-57. 

The author uses a multiple-choice test with a twist— he has his community college students 
write down why they selected the answer they did and say why at least one of the other 
answers was wrong. He briefly describes the kinds of useful information that can be obtained 
in this way. This is an informal procedure and no technical information is available. 



(TC# 440.6THITWM) 
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Kentucky Department of Education. Kentucky Instructional Results Information System 
(KIRIS) Open-Response Released Items, 1991-92. Available from: Advanced Systems in 
Measurement & Evaluation, Inc., PO Box 1217, 171 Watson Rd., Dover, NH 03820, 
(603) 749-9102. Also available from: Kentucky Department of Education, Capitol 
Plaza Tower, 500 Mero St., Frankfurt, KY 40601, (502) 564-4394. 

This document contains the released sets of exercises and related scoring guides from 
Kentucky's 1991-92 grade 4, 8. and 12 open-response tests in reading, math, science, and 
social studies. It does not contain any support materials such as. rationale, history, technical 
information, etc. 

There are three to five tasks/exercises at each grade level in each subject. Most are open- 
response (only one right answer), but some are open-ended (more than one right answer), 
especially in reading. Examples in reading are: "Would you like to be part of Jesse's family 0 
Why or why not?" "The author ends the article by saying, 'in many ways, spines are fine. 1 Do 
you agree with the author?" "Based upon the information in the Fire: A Blessing in Disguise 
article and other pertinent outside information, should fires be allowed to burn uncontrolled 9 " 

Scoring is holistic (four-point scale) and task-specific. For example, to get a "four" on the 
first question listed above, the "student gives relevant examples from the story showing why 
he or she would or would not like to be part of Jesse's family. Answer includes examples 
from student's personal experience AND it touches on how members of the family relate to 
one another." 

Kentucky has given permission for educators to copy this document for their own use. 
(TC# 060.3KENINR) 

Kinney, Martha, and Ann Harry. An Informal Inventory for Adolescents that Assesses the 
Reader, the Text, and the Task. Located in: Journal of Reading 34, 1991, pp. 643-647. 

The authors describe an informal procedure for assessing reading from a constructivist 
viewpoint. They use the procedure in grades 6-8 to look at use of prior knowledge, use of 
text structure, and making inferences. 

The authors provide some guidelines for selecting a text, making an outline of the knowledge 
structure of the text (to compare to student retellings), assessing prior knowledge 
(brainstorming and defining related vocabulary), assessing ability to gain information from 
reading (recalls, identifying referents and inference questions), and using the information once 
gathered. The authors also illustrate each step with an example. 

The method is theory based and well thought out, but no technical information is provided. 
(TC# 440.6INFINA) 
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Kietzien, Sharon B., and Msryanne R. Bed nan Dynamic Assessment for At-Risk Readers. 
Located in: Journal of i .ading , April 1990, pp. 528-533* 

The Dynamic Assessment Procedure (DAP), most valuably used with at-risk readers of all 
ages, involves the following components 

1 Initial assessment of reading ability 

2. Analysis of a student's reading processes and strategies 

3. Presentation of a learning mini-lesson for one area in which the student needs assistance 

4. Analysis of the student's ability to benefit from the mini-lesson 
(TC# 440.3DYNASF) 

Knight, Janice Evans. Coding Journal Entries. Located in: Journal of Reading 34, 1990, 
pp. 42-47. 

This article describes a system for coding reading journal entries to promote student self- 
reflection and to improve reading strategies and comprehension. The impetus for this system 
came from the author's observation that many reading-journal entries were only superficial 
summaries of what was read. The author wanted to make journal entries more meaningful. 
Each journal entry is coded by the student and/or teacher on level of thinking, metacognitive 
strategies, and confusion. Examples are: 

1. Level of thinking — "R" means "recall," and "O" means "inference, prediction, or cause and 
effect. 

2. Metacognitive strategy — "S" means "summarize/' and "SQ' means "self-questioning." 

3. Confusion — "O" means that the entry does not say anything significant, and "?" means that 
the entry indicated student confusion. 

The promise of this system is that the coding system is integrated with instruction so that 
students learn what good reading strategies are, and then assess them in their own journal 
entries 

(TC# 440.3CODJOE) 

Larter, Sylvia. Benchmarks: The Development of a New Approach to Student Evaluation, 
1991. Available from: Toronto Board of Education, 155 College St., Toronto, 
ON, M5T 1P6, Canada, (416) 598-4931. 

Benchmarks are student performance assessment tasks tied to Provincial Educational goals. 
Each Benchmark lists the goals that are addressed, the task, and the task-specific holistic scale 
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used to judge performance. Students are also rated on perseverance, confidence, willingness, 
and prior knowledge, depending on the Benchmark. There are 129 Benchmarks developed in 
language and mathematics for grades 3, 6, and 8. 

The percent of students in the sample tested at each score point (e.g., 1-5) are given for 
comparison purposes, as are other statistics (such as norms), when appropriate. Anchor 
performances (e.g., what a "3" performance looks like) are available either on video or in hard 
copy. 

This report describes the philosophy behind the Benchmarks and how they were developed. 
Some sample Benchmarks (without anchor performances) are provided in the appendices. 

(TC# 100.6BENCHM) 

Lidz, Carol. Practitioner's Guide to Dynamic Assessment 1991. Available from: Guilford 
Press, 72 Spring St M New York, NY 10012, (800) 365-7006. 

Dynamic assessment involves the following features. 

1 . The assessor actively works to facilitate learning and induce active participation in the 
learner. 

2. The assessment focuses on processes rather than products. 

3. The assessment produces information about learner modifiability and the means by which 
change is best accomplished. 

The procedure is employed when you want to know the responsiveness of the learner to 
intervention, the repertory of problem-solving processes or strategies employed by the 
student, and the means by which the change is best effected. The author describes some major 
applications of this approach — examination of general problem-solving abilities, a substitute 
for intelligence testing, and application to academic content (beginning reading and math). 

However, the majority of the book is devoted to the presentation of two assessment devices 
developed by the author: The Mediated Learning Experience Rating Scale and the Preschool 
Learning Assessment Device. The former is designed to assess the types of instructional 
strategies used by teachers. The latter is designed to assess the status and modifiability of 
preschool student problem-solving abilities. Although the approach is general problem 
solving, there is some discussion of applying it to specific content areas. 

(TC# 000.3PRAGUD) 
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Lock, Leonard K., Leann R. Miller, and James R. Masters. A Preliminary Evaluation of 
Pennsylvania's 1990 Wholistic Model Reading Tests, April 1991. Available from: 
Pennsylvania Department of Education, Division of Educational Testing and 
Evaluation (12th Floor), 333 Market St., PO Box 91 1, Harrisburg, PA 17126, 
(717) 783-6788. 

Pennsylvania has modified its statewide reading assessment of students in grades 3,5, and 8 to 
include complete passages, comprehension questions based on the passages (43-48 questions), 
prior knowledge of the topics covered in the passages (7-8 questions), reading strategies (5- 
10 questions), and habits/attitudes (3-4 questions). This is very similar to the procedure used 
in Michigan and Illinois. This entry describes the results of the first year of this assessment. 
Results included the findings that: 

1 . Scores increased as prior knowledge of the students increased, and as knowledge of 
strategies increased. 

2. Students seemed to answer the attitude questions honestly based on several lines of 
evidence. 

The term "wholistic" in the title appears to refer to the attempt to measure all aspects of good 
reading using a more realistic approach, rather than to how student performances were 
scored. (Indeed, multiple-choice questions were used.) 

(TO 440.3PREEVO) 

Maryland State Department of Education. Maryland School Performance Assessment 
Program: Sample Activities, Student Responses, and Maryland Teachers 9 Comments on a 
Sample Task, February 1991. Available from: Maryland State Department of 
Education, Maryland School Performance Program Office, 200 W. Baltimore St., 
5th Floor, Baltimore, MD 21201, (410) 333-2000. 

This document provides a sample grade 5 reading/writing/lapguage-usage performance 
assessment used in the Maryland assessment program. It includes the sample task, draft 
scoring criteria, sample student responses to the task, and Maryland teacher comments on the 
task. It was developed to familiarize teachers with the procedure. 

(TC# 440.3MARSCPr) 

Massachusetts Educational Assessment Program. On Their Own: Students 9 Response to 
Open-Ended Tests in Reading, 1991. Available from: Massachusetts Department of 
Education, 350 Main St., Maiden, MA 02148, (617) 388-3300. 

The document we received contained nssessment materials for grades 4, 8, and 12 covering a 
period of three years (1988-1990) in four subject areas (reading, social studies, science and 
math). This entry describes only the 1990 assessment in reading. The open-ended reading 
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assessment is based on the notion that students do not simply acquire knowledge from text, 
but rather construct meaning, relate information and themes to their own lives, and critically 
analyze materials. Reading is also a powerful context for critical thought. 

Students were asked to read various passages including poems, stories, information, and 
materials from daily life (e.g., advertisements). They responded to questions about metaphor, 
themes, predicting actions or reactions of characters, identifying the most important 
information, reading strategies, use of context to interpret meaning, and writers' stance. This 
entry contains sample items and student responses, plus an introduction to the thinking behind 
the approach. 

(TC# 440.3ONTHEOr) 

McCormick, Sandra, Robert Cooter, and John McEneaney. Assessment of Disabled 
Readers: A Survey of Current Teacher Beliefs and Practices. Located in: Journal of 
Reading 35, 1992, pp. 597-599. 

This paper reports on an International Reading Association survey of membership to find out 
current teacher beliefs and practices concerning assessment. The results are very interesting. 
For example, in response to the question, "What specific questions would you like >o have 
answered about the assessment of disabled readers?" the five most common responses were: 

1 How can assessment information be translated into instructional practice? 

2. What do research and practice suggest is the best approach to assessment 9 

3. How are portfolios and writing assessment being used to assess disabled readers 9 

4. What are whole language assessment techniques and how do they compare to traditional 
diagnostic methods? 

5 What is the role of attitude, home environment, and parental involvement in diagnosis and 
remediation 9 

This might be useful for planning professional development events. 
(TC# 440.6ASSDIR) 

McDonald, Joseph P., Sidney Smith, Dorothy Turner, et al. Graduation by Exhibition — 
Assessing Genuine Achievement, 1993. Available from: Association for Supervision and 
Curriculum Development, 1250 N. Pitt St., Alexandria, VA 22314, (703) 549-9110, 
fax (703) 549-3891. 

This book discusses a strategy for school reform called "planning backwards from exhibitions" 
in which schools postpone consideration of change in order to first consider what the school's 
aim is for students and how they will know if their aim succeeds. Schools define a vision of 
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what they want for graduates by proposing a vision of what tasks they want them to do well. 
Having imagined the tasks, they compare the vision against reality. Then they plan backwards 
what students would need to know anc. be able to do at various grades or ages in order to 
achieve the goal by grade 12. 

This booklet describes this process using three case studies, emphasizing different tasks 
(called "platforms) — writing position papers, inquiring and presentating, and participating in 
discussion seminars. 

(TC# 150.6GRAEXA) 

McKenna, Michael, and Dennis Kear* Measuring Attitude Toward Reading: A Neyv Tool 
for Teachers. Located in: The Reading Teacher 43, May 1990, pp. 626-639. 

This paper reports on the development of the Elementary Reading Attitude Survey for use in 
grades 1-6. There are 20 items, 10 on academic reading ana 10 on recreational reading. 
Students read each question (such as "How do you feel about spending free time reading?") 
and then indicate their response by circling one of four Garfield cartoon characters drawn to 
show different levels of excitement or boredom. 

The complete instrument, along with administration instructions and norms (based on 18,000 
students) are included. Some reliability and validity information is also given. As with other 
measures of this type, estimating validity is problematic because it involves identifying other 
measures of attitude with which to compare self-ratings. In this case, the authors compared 
self-ratings to whether or not the student had a library card, the number of books.currently 
checked out, amount of television watched, and holistic teacher ratings of student ability. 
Because of the inherent conceptual problems here, the instrument is best used informally. 

(T-;# 440.3MEATOR) 

McTighe, Jay. Maryland School Performance Assessment Program — Reading, Writing, 
Language Arts, 1991. Available from: Maryland State Department of Education, 
200 VV. Baltimore St, 5th Floor, Baltimore, MD 21201, (410) 333-2000. 

This document contains: Maryland's philosophy for developing performance assessments; 
statements of targets in reading, language arts and math; a description of the Dimensions of 
Thinking framework (published by ASCD and adopted by Maryland to develop assessments 
of student thinking); and a description of Maryland's thematic reading tests. 

The reading targets include reading for different purposes; constructing meaning from the text 
using reading skills, strategies, and background knowledge; and interacting in different ways 
with various types of texts. The "thematic" reading format involves using the same passage 
and answering a series of short answer questions, and then writing an essay. 

(TO 400.3MDRWLA) 
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Meltzer, Lynn J. Surveys of Problem-Solving & Educational Skills, 1987. Available from: 
Educator's Publishing Service, Inc., 75 Moulton St., Cambridge, MA 02138, 
(617) 547-6706, (800) 225-5750. 



Although this is a test published primarily for diagnosing learning disabilities for students aged 
9- 1 4, it has some interesting ideas that could be applied more generally. There are two parts 
to the test — a more-or-less standard, individualized aptitude test, and a series of achievement 
subtests. In addition to decoding skills, vocabulary knowledge, and the ability to separate 
words in a paragraph that has no word spacing, the reading subtest also requires an oral 
retelling of a story and oral responses to comprehension questions. The oral retelling is 
scored on order of recall, amount of recall, and the recall of important ideas in the passage. 

The most interesting part of this test, however, is that after each subtest is administered, the 
teacher is guided through an analysis of the student's strategies in completing the task — 
efficiency of approaching tasks, flexibility in applying strategies, style of approaching tasks, 
attention to the task, and responsiveness during assessment. In the aptitude portion of the 
test, the teacher also assesses the student's ability to explain his/her own strategies. 

A review of this instrument in The Reading Teacher, November 1989, concluded that, since 
there is little evidence of validity presented by the author, the test should be used informally 
for classroom assessment. The reviewer also states: "The SPES, rather than attempting to 
measure underlying cognitive abilities, instead appears to emphasize underlying strategy 
awareness and use. This orientation appears to reflect the important recent developments in 
educational thinking, emphasizing the child as a problem solver who uses intentionally 
selected strategies to improve understanding and learning." (p. 176) 

(TC#010.3SUROFP) 



Meyers, Joel, Susan Lytle, Donna Palladino, et al. Think-Aloud Protocol Analysis: An 
Investigation of Reading Comprehension Strategies in Fourth- and Fifth-Grade Students. 
Located in: Journal of Psvchoeducational Assessment 8, 1990, pp. 112-127. 

The authors used "think alouds" to assess 4th and 5th grade students' use of such reading 
strategies as reasoning, elaboration, signaling understanding, analysis, judging, and monitoring 
doubts while they were reading three fictional passages. Use of strategies was stable across 
passages for the students. Reasoning and signaling understanding was significantly related to 
reading comprehension. The list of strategies is provided, but there are no samples of student 
speech to illustrate them. 



(TC# 440.3THIALP) 



MVREL January 1 995 30 Reading Resources 

Test Center. (503) 275-9582 



Morrow, Lesley. Retelling Stories as a Diagnostic Tool. Located in: Susan Mandel Glazer, 
Lyndon W. Searfoss, and Lance M. Gentile (Eds.), Reexamining Reading Diagnosis: 
New Trends and Procedures , 1988, pp. 128-149. Available from: International 
Reading Association, 800 Barksdale Rd., PO Box 8139, Newark, DE 19714, 
(302) 731-1600. 

The author: (1 ) provides a set of instructions to guide student retelling of a reading passage; 

(2) includes a sample checklist to use when analyzing the retelling for comprehension; 

(3) provides an example of how to analyze a retelling to show knowledge of setting, theme, 
resolution, and sequence (story structure); and (4) presents one technique for analyzing the 
retelling for average length of clauses and syntactic complexity (to assess language 
complexity). 

(TC# 440.3RETSTD) 

Mossenson, Leila, Peter Hill, and Geofferey Masters. (TORCH) Tests of Reading 

Comprehension, 1988. Available from: Australian Council for Educational Research, 
Ltd., (ACER), Private Bag 55, Camberwell, Victoria 3124, Australia, (03) 277-5555, 
fax: (03)277-5500. 

TORCH is a set of 14 graded passages (200-900 words) for use with students in grades 3-10 
to assess the extent to which readers are able to obtain meaning from text. Students are 
presented with the original text and with a retelling of the text which leaves out certain details 
from the original. Students complete the retelling by filling in the gaps. Responses are 
short — at most 10 words. The test is designed so that, in order to fill in the gaps, the student 
must use 1 of 1 1 reading skills. (Examples are: complete simple rewordings. connect ideas 
separated in the text, and infer emotion.) 

This is administered as a group test and student responses are scored "acceptable" or "not 
acceptable" by comparison to models provided in the scoring guide. Results are interpreted 
by noting which reading skills the student can perform (e.g., finding facts), and which he or 
she is unlikely to perform (e.g., providing a detail in the presence of distracting ideas). 

(TC# 440.3TORCHT) 

Myers, Miles. Problems and Issues Facing the National Standards Project in English. 
Located in: Education and Urban Society 26, February 1994, pp. 141-157. 

This paper relates the history, from 1890 to the present, of attempts made to set standards in 
English and language arts. 

(TC# 400.5PROISF) 



NAVRKL Januan. 1995 
Test Center. (503) 275-9582 



31 



Reading Resources 



National Council of Teachers of English (NCTE). [Standards Project — various articles.] 
Located in: The Council Chronicle , Available from: NCTE, 1111 W. Kenyon Rd., 
Urbana, IL 61801, (217) 328-3870, (800) 369-6283, fax (217) 328-9645, 



This document is a combination of the following articles from The Council Chronicle 3: 
NCTE staff. Frequently Asked Questions about the Standards Project, April 1994, pp. 4-5; 
Anna Flanagan, Standards Project Seeks Wider Audience for Work to Date, April 1994, p. 5; 
and NCTE staff, NCTE IRA Say Standards Effort Will Continue, June 1994, pp. 1 & 4. 

These short articles summarize the progress of the Standards Project for English Language 
Arts, a joint venture of NCTE, the Center for the Study of Reading at the University of 
Illinois, and the International Reading Association. The spring 1994 draft standards are 
included for language, reading, and writing. 

(TC# 440.5STAPRV) 

Oregon Department of Education. Oregon Open-ended Reading Assessment, 1993. 

Available from: Oregon Department of Education, 255 Capital St M NE, Public Service 
Bldg M Salem, OR 97310, (503) 378-8004. 

Oregon is experimenting with assessing student reading ability in grades 4, 7, and 10 using a 
procedure in which students read a complete passage (6 pages or so) and answer a series of 
open-ended questions. Examples of questions are: "What is your first response to this 
story 01 ' fct Explain how your own experiences helped you understand the story/ 1 and fcl Brian has 
always had good feelings about the outdoors. Do you think his opinion has changed? Explain 
your reasons. 11 Passages are narrative, expository and persuasive. Some tasks require both 
individual and group work. Tasks extend over several days. 

Student reponses are scored on 4 traits: constructing meaning, making connections within 
text, making connections beyond text, and risk taking. Student responses to the complete set 
of questions are scored together. Two readers score each response. 

This document includes one complete fourth grade reading task, 3 complete student 
performances on this task (rated high, medium and low), miscellaneous student reponses from 
parts of other fourth grade tasks, the 4-trait scoring guide, the rationale and procedures for 
the assessment, survey results of student response to the task, specifications for designing 
reading performance tasks, and score distributions from the 1993 pilot test. 

(TC# 440.3OREOPE) 

Paratore, Jeanne R M and Roselmina Indrisano. Intervention Assessment of Reading 
Comprehension. Located in: The Reading Teacher , April 1987, pp, 778-783. 

This article describes an assessment procedure designed to both assess a student's present 
performance and to discover the facility with which that student can be taught. The procedure 
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examines the student's ability to employ reading strategies (such as using background 
knowledge to predict passage content and using knowledge of passage structure to aid 
comprehension) both independently, and with modeling, if needed. 

(TC# 440.3INTASO) 

Peers, Mtchele G, A Teacher/Researcher's Experience with Performance-Based Assessment 
as a Diagnostic Tool 99 Located in: Journal of Reading 36, April 1993, pp. 544-548, 
Also available from: International Reading Association, PO Box 8139, Newark, DE 
19714. 

This paper describes one teacher's attempt to gain information about college students' skills in 
reading, research, forming and supporting a position, and writing (rhetorical and mechanical 
skills) by adapting performance assessment materials developed by the Center for Reading and 
Language Studies at Indiana University. The author used a task that required students to 
learn about a water shortage problem, and devise a solution. The article is a nice non- 
technical presentation of her rationale, procedures, scoring guide and discoveries, both about 
her students and about the assessment itself. The scoring guide is a seven-point scale that 
assesses three dimensions of reading and writing — control of reading, control of content, and 
control of language. 

(TC# 400.6TEAREE) 

Peterson, Anita A. Developing One Type of Performance Assessment: A Criterion- 
Referenced Reading Assessment, 1993. Available from: Kamehameha Schools, 
1887 Makuakane St., Honolulu, HI 96819, (808) 842-8832. 

The author describes a reading assessment currently under development for students in 
grade 3. Actual reading texts are not included; however, specifications for selecting text 
materials and writing open and multiple-choice questions are provided in detail. In fact, this is 
an excellent example of clear test specifications. Some scoring guidelines are also provided, 
as are some statistics from the May 1992 administration. 

(TC# 440.3DEVONT) 

Phillips, Linda. Developing and Validating Assessments of Inference Ability in Reading 
Comprehension, Technical Report No. 452, 1989. Available from: Center for the Study 
of Reading, University of Illinois at Urbana-Champaign, 174 Children's Research 
Center, 51 Gerty Dr., Champaign, IL 61820. 

The Test of Inference Ability was designed to measure one component of reading 
comprehension — making inferences. It was designed for grades 6-8, to be given in one class 
period, and uses ftill-length passages of three types: expository, narrative and descriptive. 
There are parallel multiple choice and open-ended response versions. 
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The author begins by critiquing current standardized tests of reading comprehension. The 
arguments are somewhat different from others: standardized tests seem to test general 
knowledge more than reading comprehension, and they do not articulate a clear definition of 
reading comprehension so that validation is possible. 

The authors validated the multiple-choice test by comparing performance to the ability to infer 
as judged directly using a set of performance cnteria provided in the text. The criteria 
basically hinge on completeness and consistency. See other entries by Phillips for a published 
version of the instalment (manual, multiple-choice version, and constructed response version). 

(TC# 44G.3DEVVAA) 

Phillips, Linda. Test of Inference Ability in Reading Comprehension, 1989* Available from: 
Institute for Educational Research and Development, Memorial University of 
Newfoundland, St. John's, NF A1B 3X8, Canada, (709) 737-2345. 

The Test of Inference Ability was designed to measure one component of reading 
comprehension — inferencing ability. It was designed for grades 6-8, to be given in one class 
period, and uses full-length passages of three types: expository, narrative and descriptive. 
There are parallel multiple choice and open-ended response versions. There are 12 questions 
per passage. The questions for the multiple-choice version and the constructed-response 
versions are the same. 

In the multiple-choice version the students can earn from 0 to 3 points depending on his or her 
choice. Three points are awarded when the choice is both consistent and complete, two for a 
partially correct answer, 1 for a text-based answer and 0 for a wrong answer. The 
constructed-response version also assigns 0-3 points for each response; the multiple-choice 
options are given as models for assigning points in the constructed-response version. 

Although scoring is task-specific, the authors provide a generalized holistic 0-3 scale for 
judging completeness and consistency (the criteria the authors use to judge student ability to 
infer) and provide the reasoning behind assigning some of the responses to different point 
values. This provides some of the help needed to apply the concepts of consistency and 
completeness to reading tasks other than those on the test. 

All in all this appears to be a fairly well thought out and researched instrument. 
(TC# 440.3TESINA) 

Pikulski, John. The Assessment of Reading: A Time for Change? Located in: The 
Reading Teacher , October 1989, pp. 80-81. 

The author presents a listing of ways that assessment in reading needs to change. His 
suggestions are based on standardized, nationally normed tests and include such comments as: 
"Assessment of reading must shift from being test-centered to being teacher- and pupil- 
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centered/' and "The form of reading assessment must reflect the goals of instruction and the 
dynamic, constructionist nature of the reading process." The author then goes on to describe 
how The Reading Teacher intends to modify the content of its Assessment column to reflect 
these new directions 

(TC# 440.6ASSREA) 

Pikulski, John, Informal Reading Inventories (2nd Ed). Located in: The Reading 
Teacher, March 1990, pp. 514-516, 

This article describes the latest editions of four popular informal reading inventories: Analytic 
Reading Inventory (ARI — 1989), Basic Reading Inventory (BRI — 1988), Classroom Reading 
Inventory (CRI— 1989), and Informal Reading Inventory (IRI-BR— 1989). The author feels 
that the IRJ-BR and the ARI have the greatest breadth of assessment materials; that the ARI 
would be the inventory of choice for an examiner who wants to assess science and social 
studies; the CRI would be good for disabled readers; and the IRI-BR is best for assessing 
reading beyond grade nine difficulty. 

(TC# 440.1 INFREI2) 

Polakowski, Cheryl. Literacy Portfolios in the Early Childhood Classroom. Located in: 
Laura Grosvenor, et al., Student Portfolios , 1993, pp. 47-65. Available from: National 
Education Association (NEA) Professional Library, PO Box 509, West Haven, 
CT 06516, (800) 229-4200. 

This paper is one of several in a book written by teachers participating in projects to take 
control of assessment and align assessment to their whole-language instruction. The author 
describes a portfolio system that collects the following information for kindergarten students: 
self-portrait (art), an interview with the child, an interview with the parent, concepts about 
print, word awareness (spelling), sight word list, reading sample, writing sample, attendance, 
story retelling, and other information teachers would like to include. Teachers assemble the 
information for students. 

The author includes a discussion of the steps the teachers pursued in developing their portfolio 
system, help with what worked best and interacting with parents, hints on time management, a 
nice developmental continuum for reading and writing (with six stages), interview questions, 
word awareness activity, sample sight word list, instructions for the reading sample, miscue 
analysis and retelling, and record keeping forms. 

No samples of student work or technical information i r provided. 

(TC# 440.3LITPOC) 
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Portland Pubic Schools. Reading Assessment: Recording Student Progress, 1989. Available 
from: Portland Public Schools, PO Box 3107, Portland, OR 97208, (503) 249-2000. 



Portland Public Schools has assembled a package of informal classroom assessment tools in 
reading for students in grades K-2 to provide ideas to teachers on how to assess reading 
process skills. Additionally, the package advocates the use of portfolios since many samples 
of student work need to be collected over time in order to provide a complete picture of 
student progress. 

Specific instruments in the package include a developmental spelling test; a checklist covering 
reading attitudes, behaviors, concepts about print, and reading strategies; an inventory 
concerning reading habits; suggestions for reading journals; a procedure for analyzing 
comprehension using retelling; and a series of checklists that covers such things as concepts 
about books, sense of story, and understanding of print. The rationale for each instrument is 
provided; no technical information is provided. 

(TC# 440.3REAASR) 

Province of British Columbia. Supporting Learning — Understanding and Assessing the 
Progress of Children in the Primary Program — A Resource for Parents and Teachers, 
1991. Available from: Ministry of Education, Province of British Columbia, 
Parliament Buildings, Victoria, BC V8V 2M4, Canada (604) 387-4611, 
fax (604) 356-2504. 

This document was produced to clarify what is known about the development and learning 
processes of students aged 3-13 and to explain changes in assessment. There are very nice 
summaries of the research on how children learn (p. 7); how and why instruction and 
assessment have changed (p. 10); the idea of tracking student progress using developmental 
continuums; and gathering information using collections of student work, discussions with 
students, and observation. 

The document includes developmental continuums for aesthetics, social responsibility, formal 
reasoning, physical ability, reading, writing, and mathematics. 

(TC# 070.3SUPLEU) 

Psychological Corporation, The. GOALS: A Performance- Based Measure of 

Achievement — Reading, 1993. Available from: The Psychological Corporation, Order 
Service Center, PO Box 839954, San Antonio, TX 78283, (800) 228-0752. 

GOALS was designed as an intermediate format between multiple-choice and performance 
assessment. Students read short passages and write short answers to fairly standard 
comprehension questions such as: thinking about characters, events, situations, facts and 
settings; suggesting appropriate reading strategies; and using thirling skills to determine fact 
vs. opinion, to identify supporting evidence, and to predict what will happen next. This has 
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the flavor of a multiple-choice test; the difference is that students write short answers instead 
of choosing answers from a list. Both narrative and informational passages are used for all 
levels except Level 1 . Scoring is done on a four-point scale (0-3) in which "3" is "The student 
response is correct/ logical (or very nearly so) and is clearly based on relevant and explicit 
information in the passage. All parts of the question are fully answered." This generalized 
rubric is used for all responses. Sample student answers for each score point on each exercise 
are provided. 

The documents we have contain little rationale for the questions or passages and no technical 
information. Presumably this is available from the publisher upon request. 

(TC# 440.3GOALSr) 

Rea, Dean W. and David K. Thompson. Designing Transformative Tests for Secondary 
Literature Students. Located in: Journal of Reading 34, 1990, pp. 6-11. 

The authors maintain that current tests of reading comprehension do not correspond to 
current theories concerning how meaning is constructed from text. They propose designing 
open-ended questions for students that are based on entire reading selections rather than on 
excerpts. These open-ended questions represent three levels of comprehension; literal, 
interpretive and applied. Examples of such questions are provided for three reading 
selections. Some criteria for evaluating the responses of students are also included. For 
example, students 1 responses to a persuasive question could be evaluated for plausibility, 
relevance, clarity, organization, and detail of the supporting material. Criteria are, however, 
not defined in detail. 

(TC# 440.6DESTRF) 

Rhodes, Lynn K., Ed. Literacy Assessment — A Handbook of Instruments, 1993. Available 
from: Heinemann, A Division of Reed Publishing Inc., 361 Hanover St., Portsmouth, 
NH 03801, (603) 431-7894. 

This document includes a series of information-gathering instruments in the following areas: 
reading attitudes, comprehension strategies, miscues, writing attitudes, spelling, and student 
self-assessment. It also includes a form for observing whole language teaching. 

Most examples are teacher developed. Some are more complete than others (e.g., they 
include the instrument and help with scoring/analysis). There is no context setting in the sense 
of describing current thinking about goals for students and how the instruments fit in. 
Therefore, it requires knowledgeable teachers who already have a sense of what information 
they want to collect and why, and how to use it. The document looks like something 
appropriate for beginners but, in actuality, it requires knowledgeable users to use it well. 
There is a good bibliography of developmental continuums. 

(TC# 400.3LITASH) 
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Riverside Publishing Company. Performance Assessments for ITBS, TAP and ITED, 1993. 
Available from: The Riverside Publishing Company, 8420 Bryn Mawr Ave., Chicago, 
IL 60631, (800) 323-9540, fax (312) 693-0325. 

Riverside is publishing a series of open-response items in the areas of social studies, science, 
mathematics, and language arts. They supplement achievement test batteries available from 
the publisher: ITBS, TAP, and ITED. Nire levels are available for grades 1-12. Each level 
uses a scenario to generate a series of related questions, some of which have only one right 
answer, and others of which are more open-ended and generative. 

No information about scoring, no sample student performances, and no technical information 
was included in the materials we received. However, the publishers catalog indicates that 
scoring materials are available and that the tests are normed. 

(TC#060.3PERAST)— IN-HOUSE USE ONLY 

Roswell, Florence G., and Jeanne S. ChalL Creating Successful Readers — A Practical Guide 
to Testing and Teaching at All Levels, 1994. Available from: The Riverside Publishing 
Company, 8420 Bryn Mawr Ave., Chicago, IL 60631, (800) 323-9540. 

This book is definitely written for teachers with responsibility for designing educational 
programs for students with reading difficulties. The authors have the following philosophy: 
"...the most effective approach to improving the reading achievement of individuals who have 
fallen behind is through a direct assessment of their status and pattern of strengths and 
weaknesses in reading and related areas, followed by instruction that is based on this 
information." 

The authors also produced the DARTTS, published by Riverside. The book provides a longer 
discussion of the philosophy behind, and use of, strategies similar to those in the DARTTS. 
Specifically it discusses both diagnostic batteries to pinpoint reading problems and "trial 
lessons" to identify effective teaching strategies. A nice developmental continuum and 20 case 
studies for reading are included. 

(TC# 440.6CRESUR) 

Roswell, Florence G., and Jeanne S. Chall. DARTTS: Diagnostic Assessments of Reading 
and Trial Teaching Str«">'iies, 19*22. Available from: Riverside Publishing Company, 
8420 Bryn Mawr Ave., Chicago, IL 60631, (800) 323-9540, fax (312) 693-0325. 

The DARTTS is an assessment/instructional package that combines fairly traditional, 
individualized reading testing with sample lessons designed to find suitable methods for 
teaching students to read. Since there was no discussion of the theoretical underpinnings for 
the tests, it was difficult to evaluate their comprehensiveness; however, they appeared to be 
fairly traditional: word recognition, vocabulary, spelling, oral miscue analysis and silent 
reading comprehension (based on simple multiple-choice questions). The interesting part is 
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the attempt to link results with instruction. However, there was also no rationale given for the 
instructional strategies provided, so it is up to the reader to judge appropriateness and 
correspondence to current theories of reading. 

(TC# 440.3DARTTS) 

Rowell, C. Glennon. An Attitude Scale for Reading. Located in: Reading Teacher 25, 
February 1972, pp. 442-447. 

This article describes the Scale of Reading Attitude Based on Behavior. In this scale, another 
person observes a child in various reading situations and rates 16 behaviors, such as: "The 
student exhibits a strong desire to come to the reading circle or to have reading instruction 
take place/' a.id "The student asks permission or raises his hand to read orally." Each 
behavior is rated on a five-point scale from "always occurs" to "never occurs." 

The paper presents the entire scale and the results of pilot-testing, which show that ratings 
between observers can be very consistent. As with all measures of this type, validity is an 
issue because of the need to identify a second way to estimate attitude with which to compare • 
the ratings in the instrument. In this case, the authors chose holistic ratings by 'he same 
teachers in the reliability study. Because of these concerns, it is best that the instrument be 
used informally. 

(TC# 440.3ATTSCR) 

Royer, James. The Sentence Verification Technique: A New Direction in the Assessment of 
Reading Comprehension. Located in: Sue Legg and James Algina (Eds.), Cognitive ' 
Assessment of Language and Math Outcomes , 1990, pp. 144-181. Available from: 
Ablex Publishing Corp., 355 Chestnut St., Norwood, NJ 07648. 

In this paper, the author reviews the theory and research that underlies a new technique for 
measuring reading comprehension. It includes a good, readable summary of current theories 
of reading comprehension and how current measures of reading comprehension (multiple- 
choice tests and cloze techniques) relate to these theories. 

The author also considers the similarities between current theories as the underpinning for his 
Sentence Verification Technique, which he calls a measure of reading achievement, as 
opposed to a measure of reading ability. This procedure entails developing four variations of 
sentences in a passage: 

1 . The original sentence 

2. A paraphrase of the original sentence that does not change its meaning 

V A change in one or two words in the sentence so that the meaning is changed 
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4. A sentence with the same syntactic stmcture as the original sentence, but which is unrelated 
in meaning to any sentence that appeared in the passage 

Students identify which sentences are "old" (types 1 and 2), and "new" (types 3 and 4). 

The author also describes a number of studies done on this technique to establish its validity 

(TC# 440.6SENVET) 

Salinger, Terry. Classroom-Based and Portfolio Assessment for Elementary Grades. 

Located in: Carolyn Hedley, Dorothy Feidman, and Patricia Antonacci (Eds.), Literacy 
Across the Curriculum , 1992, pp. 133-155. Available from: Ablex Publishing 
Corporation, 355 Chestnut St., Norwood, NJ 07648. 

This paper discusses the current state of assessment and makes two suggestions for its 
improvement: taking advantage of the assessment opportunities within classroom instruction 
interactions, and using portfolios to assess literacy growth. Of special interest: 

• A list of 14 questions that must be addressed when planning alternative assessments 

• Examples of classroom opportunities for observing students 

• A discussion of the necessity for clear criteria for success and for clearly communicating 
criteria to students 

• A rubric for assessing literacy portfolios. Included are writing, reading and content area 
knowledge (six levels of achievement are specified) 

• Other ways to assess portfolios in addition to using rubrics — more open-ended 
examinations and posing individual questions 

• Ideas for grading using portfolios 
(T«J# 400.6CLABAP) 

Summons, Rebecca Bell, and Beth Davey. Assessing Students' Skills in Using Textbooks: 
The Textbook Awareness and Performance Profde (TAPP). Located in: Journal of 
Reading 37, December 1993-January 1994, pp. 280-286. Also available from: The 
University of Maryland, 1117 Benjamin Bldg., College of Education, College Park, 
MD 20742. 

The authors describe an interview procedure that teachers can use to gain information about 
student (grade four and above) proficiency in the use of textbooks. The TAPP has tnree 
sections: 
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1 a metacognitive interview to investigate the student's perceptions of how the textbook is 
used both in and out of the classroom; 

2. a series of tasks to assess the student's ability to interact with the textbook; and 

3. a summary' sheet to record observed strengths and needs 

The assessment takes about 45-60 minutes. It can be used with textbooks in any subject area. 
The student can choose the textbook(s) to use. The paper includes detailed information and 
forms for administration. A couple of examples of use with students are provided. The 
procedure has been pilot-tested but technical information is not included in the article. 

The paper provides enough information to decide on whether to use it; additional information 
would have to be obtained from the authors in order to actually use it with students. 

(TC# 440.3ASSSTT) 

Schmitt, Maribeth Cassidy. A Questionnaire to Measure Children's Awareness of Strategic 
Reading Processes [Metacomprehension Strategies Index]. Located in: The Reading 
Teacher , March 1990, pp. 454-461. 

This article describes a 25-item survey/test which asks thud- through sixth-grade students 
about their knowledge of reading strategies. 

(TC# 440.3METSTI) 

Serrano, Claudia. A Look at Portfolio Assessment in San Diego High School's Sophomore 
House, 1991. Available from: San Diego City Schools, 4100 Normal St., Room 3133, 
San Diego, CA 92103, (619) 298-8120. 

This paper describes an interdisciplinary (physics, math, and English) portfolio system for 
tenth graders that supports block scheduling in an inner city magnet school. Students keep a 
notebook of all work in each class. Class portfolios are developed from selected work in the 
notebook. Class portfolios are used as the basis for the culminating "House Portfolio" in 
which students select work to demonstrate that they have attained specified learning goals. 
The "House Portfolio" also includes written reflection and a final exhibition of mastery. 

The document includes student instructions for assembling the portfolio, an entire student 
portfolio, instructions for a formative oral presentation of their portfolio, checklists and 
evaluation forms, and assistance with reflective writings and exit exhibitions. 

No technical information is included 

(TC# 000.3LOOPOA) 
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Shannon, Albert. Using the Microcomputer Environment for Reading Diagnosis* Located 
in: Susan Mandel Glazer, Lyndon W. Searfoss, and Lance ML Gentile (Eds.), 
Reexamining Reading Diagnosis: New Trends and Procedures , 1988, pp. 150-168, 
Available from: International Reading Association, 800 Barksdale Rd M PO Box 8139, 
Newark, DE 19714, (302) 731-1600, 

The author maintains that "the reading- and language-related microcomputer environment 
allows students to engage in four language-generating activities: drill and practice, tutorial, 
adventure/simulation and problem solving, and composing/writing. Each of these 
environments provides opportunities to diagnose students' language fluency, composing 
abilities, expression of self-concept, view of the world, and story sense." 

The author describes how microcomputers are currently used for each of the language- 
generating activities, outlines the types of information that can be obtained from watching 
students interact with the computer in each area, and presents a checklist to use when 
observing students using each type of program. Checklist items include things such as 
confidence when using the program, apparent motivation, ability to predict and control 
software, metacognitive strategies, ability to understand instructions, and writing features. 

(TC# 440.3USIMIE) 

Shearer, Arleen P., and Susan P. Homan. Linking Reading Assessment to Instruction — An 
Application Worktext for Elementary Classroom Teachers, 1994. Available from: 
St Martin's Press, Inc M 175 Fifth Ave., New York, NY 10010. 

The authors provide practice activities in instructional and assessment techniques for reading 
appropriate for the elementary classroom. Chapters include teacher self-assessment of reading 
diagnosis expertise, using classroom observation, using standardized tests, identifying problem 
readers, using informal reading inventories, assessing comprehension strategies, and assessing 
word recognitions and spelling. Appendices include sample checklists, record-keeping forms, 
and instructions for administering various assessments. 

(TC# 440.6LINREA) 

Snider, Mary Ann, Susan Skawinski Lima, and Pasquale J. DeVito. Rhode Island f s 
Literacy Portfolio Assessment Project, 1994. Located in: Sheila W. Valencia, Elfrieda 

H. Hiebert, and Peter P. Afllerbach (Eds.), Authentic Reading Assessment: Practices 
and Possibilities , 1994, pp. 71-88 

Rhode Island's literacy portfolio project, begun in 1989, is not mandated. Rather, it has been 
a voluntary exploration of better ways to link assessment with classroom literacy practices. 
The authors note three stages in the development of their portfolio system: 

I . Focus on mechanics — who has access, what activities could be put in and when, and what 
does a portfolio look like 
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2 Focus on student outcomes, criteria for evaluation progress, and sharing criteria with 
students 

3 Focus on self-reflection and student control. 

This document describes the development process, lessons learned, and effect on teachers, 
classrooms, and students. The actual portfolio model is not described 

(TC# 400.3RHOISL) 

Stable, Debra L., and Judith P. Mitchell. Portfolio Assessment in College Methods Courses: 
Practicing What We Preach, Located in: Journal of Reading 36, April 1993, 
pp. 538-542. 

This article is by two university teachers who are tying to model appropriate literacy 
instruction and assessment in their own reading and language arts methods courses. Their 
discussion of issues, procedures and constraints regarding portfolios directly parallels those of 
teachers in grades K-12, e.g., the felt need for teacher control so that grades can be assigned. 

(TC# 130.3PORASC) Al, A2, A4, B2, C7, E6 

Stayter, Francine, and Peter Johnston* Evaluating the Teaching and Learning of Literacy. 
Located in: Timothy Shanahan (Ed.), Reading and Writing Together: New 
Perspectives for the Classroom, 1990. Available from: Christopher-Gordon Publishers, 
Inc., 480 Washington St., Norwood, MA 02062, (617) 762-5577. 

This paper is about integrating assessment and instruction — the use of assessment as a 
reflective process in which both teachers and students learn about and develop their skills. 
The entire thrust of the paper is that assessment should be an instructional tool, not one used 
simply for outside monitoring. 

The authors argue that teachers construct meaning about their students just as students 
construct meaning from text. The meanings teachers construct can be different, just as 
students' constructions of meaning can be different. Each such "reading of student ability" has 
consequences, both in what we learn about students, but also in terms of the messages we 
send to students. "What we choose to evaluate and how we choose o evaluate delivers 
powerful messages to students about those things we value, " the author stated. "Students 
view their learning and their sense of worth through the lens we help them construct unless 
they cannot bear to look through it." They give some examples of these messages, such as 
focusing on errors rather than on strengths, and focusing on conventions rather than on 
meaning. "When writers find that they are being heard, they begin to find their voice." The 
authors describe some ways to alter these messages by changing how we assess. 

They also discuss the power of self-reflection. "Without reflectiveness our students will 
develop a dependent and powerless literacy. Students must self-evaluate to be 
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independent in their learning. To do this, teachers cannot project the image that they have all 
the knowledge and ownership of the correct responses." The authors describe some ways to 
help. the reflective process such as making predictions, conferring with each other, sharing 
effective strategies, setting one's own goals, performance criteria, and portfolios. 

(TC# 150.6EVATEL) 

Taylor, Denny, Teaching Without Testing: Assessing the Complexity of Children's Literacy 
Learning. Located in: English Education 22, 1990, pp. 4-74, 

The author describes the Biographic Literacy Profiles Project, in its second year when the 
article was written. The project has endeavored to base understanding of the development of 
literacy in individual students on the careful observation and analysis of daily observable 
literacy behaviors and products. The article describes what they have learned in the following 
areas: learning how to observe children's literacy behaviors, learning to develop note-taking 
procedures to record observations of children reading and writing, learning to write 
descriptive biographic literacy profiles, and learning to increase awareness of the multiple 
layers of. interpretation that we are incorporating into children's biographic literacy profiles. 
The process requires a great deal of practice and self-reflection on the part of teachers and 
principals. 

The final part of the article describes reports from teachers and principals on how their 
approach to instruction is changing based on participation in this project. The paper has many 
samples of teacher and student thinking and work related to each topic. 

(TC# 440.3TEAWIT) 

Teale, William H. Developmental^ Appropriate Assessment of Reading and Writing in the 
Early Childhood Classroom. Located in: The Elementary School Journal 89, 1988, 
pp. 173-183. 

This article discusses two topics: what should early childhood literacy assessments measure, 
and what is the best format for measuring them 9 The author contends that informal 
observations and structured performance sample assessments are more appropriate than 
standardized tests for measuring early childhood literacy learning. The author also contends 
that emergent literacy research suggests that we gather information c< young children's 
concepts of the functions and conventions of written language, text comprehension, ability to 
read print commonly found in the home or community, emergent reading of storybooks, 
metalinguistic awareness, emergent writing strategies, and knowledge of letters, letter sounds, 
and the relations between them. The paper provides some examples of how to assess 
knowledge of the functions of written language, emergent reading of storybooks, writing 
strategies, and knowledge of letter-sound correspondences. 
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The author discusses mostly informal classroom assessment. No technical information is 
provided. No samples of student work are included. 

(TC# 070.6DEVAPA) 

Thistlethwaite, Linda L. Critical Reading for At- Risk Students [Critical Reading Checklists/. 
Located in: Journal of Readin2 , May 1990, pp. 586-593. 

This article is primarily about strategies for teaching critical reading skills to at-risk students. 
(The same procedures could be used for any population.) It is included here because it 
presents several checklists of criteria for assessing the believability of information. These 
could also be used for self-reflection or for feedback to peers. 

(TC# 440.3CRIREA) 

Tierney, Robert J., Mark A. Carter, and Laura E. Desai. Portfolio Assessment in the 
Reading-Writing Classroom, 1991. Available from: Christopher Gordon Publishers, 
Inc., 480 Washington St M Norwood, MA 02062, (617) 762-5577. 

This book was designed for classroom teachers, and the information is presented in a very 
user-friendly style and format. The authors discuss issues surrounding assessment and 
portfolios, provide many examples of portfolio systems, explore the ways that portfolios can 
be used instructionally, and show examples of criteria for assessing portfolio entries, portfolios 
as a whole, and metacognitive letters. 

(TC# 400.6PORASC) 

Touchstone Applied Science Associates, Inc. Degrees of Reading Power, 1995. Available 
from: Touchstone Applied Science Associates, Inc., Fields Lane, PO Box 382, Brewster, 
NY 10509, (914) 277-4900, fax (914) 277-3548. 

The Degrees of Reading Power has reading passages of increasing difficulty in which several 
words have been deleted. Students must select the word that best completes the meaning of 
each incomplete sentence. The rationale is that students must understand the extended 
context of the passage in order to select the correct words. This is not a vocabulary test. The 
test identifies the hardest prose that pupils can read with different levels of comprehension. 
Nine levels are available for grades 1-12. Complete norms are available. 

(TC# 440.3DEGOFR) 
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Valencia, Sheila. A Portfolio Approach to Classroom Reading Assessment: The Whys, Whats 
and Hows. Located in: The Reading Teacher , January 1990, pp. 338-340. 



In addition to discussing the rationale for using portfolios to assess reading, this article also 
suggests content for reading portfolios, how to select material for a portfolio and how the 
portfolio should be organized. 

Portfolio content might include samples of the student's work, the teacher's observational 
notes, the student's own periodic self-evaluation, and progress notes contributed by the 
student and teacher collaboratively. Specific items to be included would depend on the 
purpose for the portfolio but might include such things as written responses to reading, 
reading logs, selected daily work, classroom tests, checklists, unit projects, etc. The idea is to 
have a variety of indicators. 

The real value of portfolios, according to the author, lies not in any single approach, but rather 
in the mind set that: 1 ) sound assessment is anchored in authenticity; 2) assessment must be a 
continuous process; 3) valid reading assessment must be multi-dimensional; and 4) assessment 
must provide for active collaborative reflection by both teacher and student. 

(TC# 440.6APORAP) 

Valencia, Sheila W M Elfrieda EL Hiegert, and Peter P. Afflerbach (Eds.). Authentic Reading 
Assessment: Practices and Possibilities, 1994. Available from: International Reading 
Association, Inc., 800 Barksdale Rd., PO Box 8139, Newark, DE 19714, (302) 731-1600. 

This book describes nine projects attempting to implement "authentic" assessment in reading. 
For the editors, "authenticity in an assessment resides not in its response format, but in its 
content, the underlying constructs it taps, and the correspondence among the assessment, the 
instruction from which it samples, and the purposes for which the assessment will be used." 
The editors also point out that even the most promising projects are still "works in 
progress" — evolving and full of promise, but not yet having substantive documentation of 
effects on children's cognitive or affective development. The book contains no solutions; it 
describes the current state of the art. 

The book includes: an overview of "authentic assessment" in reading including definitions and 
rationale for alternatives, three examples of classroom assessments, three examples of 
assessments based in the classroom and used to report to other audiences, three sample large- 
scale assessments, and a summary of the state of the art. 

(TC# 440.6AUTREA) 
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Valencia, Sheila W., Elfrieda H. Hiegert, and Peter P. Aftlerbach. Realizing the Possibilities 
of Authentic Assessment: Current Trends and Future Issues, 1994. Located in: Sheila 
W. Valencia, Elfrieda H. Hiebert, and Peter P. Afflerbach (Eds.), Authentic Reading 
Assessment: Practices and Possibilities , 1994, pp. 286-300. 

This article summarizes and draws conclusions based on nine assessment case studies 
provided as previous chapters in the book. The authors note the following trends in assessing 
reading: 

1 . Assessment tasks require students to read longer, more naturally occuring, texts; questions 
are more open and complex. 

2. Assessment activities usually occur over a longer period and often include collaboration. 

3. Assessments are designed to tap specific student outcomes. 

4. There is more emphasis on affecting teaching and learning — students and teachers have 
more of a role in developing and scoring, which encourages active participation in 
activities. 

5 There is an attempt to integrate assessment at all levels and base large-scale assessment 
more on information collected in classrooms. 

The authors note the following issues: 

1 . Longer passages are not necessarily better passages, and open-ended questions do not 
ensure that the right student performances are being tapped. 

2. What goals do we have for students and should these be the same across classrooms 0 

3. Can we draw conclusions about individual students based on performance on only one or 
two tasks 0 

4. Changes in assessment sometimes do not parallel changes in instruction and both require 
professional development. 

5. Performance assessment is not necessarily equitable assessment. 
(TC# 440.6REAPOA) 
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Valencia, Sheila, William McGinley, and P. David Pearson. Assessing Reading and Writing: 
Building A More Complete Picture. Located in: G. Duffey (Ed.), Reading in the Middle 
School , 1989. Available from: International Reading Association, 800 Barksdale Rd„ 
PO Box 8139, Newark, DE 19714, (302) 731-1600. 

This paper emphasizes the importance of collecting a large number of student performance 
samples which represent a wide range of contexts. It describes the dimensions along which 
tasks differ, so that the teacher can be sure to obtain a good sampling of performance. 

(TC# 400.3ASSREA) 



Valencia, Sheila, David Pearson, Charles Peters, et ah Theory and Practice in Statewide 
Reading Assessment: Closing the Gap. Located in: Educational Leadership , 
April 1989, pp. 57-63. 

The authors report on two state assessments in reading that they feel are more reflective of 
current research on reading than the assessment approaches of most current standardized 
achievement tests. They report that the current view of reading suggests that: 

• Prior knowledge is an important determinant of reading comprehension. 

• Naturally occurring texts have topical and structural integrity 

• Inferential and critical reading are essential for constructing meaning. 

• Reading requires the orchestration of many reading skills. 

• Skilled readers apply metacognitive strategies to monitor and comprehend a variety of texts 
for a variety of purposes. 

• Positive habits and attitudes affect reading achievement and are important goals of reading 
instruction. 

• Skill :d readers are fluent. 

The authors feel that current standardized achievement tests do not reflect this body of 
knowledge while the two state assessments make an attempt to address these issues. Each has 
four parts: a full-length selection that measures constructing meaning; a section to assess 
topic familiarity; questions about metacognition and strategies; and a section on reading 
attitudes, habits, and self-perceptions. A taxonomy of skills/dispositions in these areas is 
presented. However, the tests are still in structured format: multiple-choice, etc. 

(TC# 440.6THEANP) 
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Wade, Suzanne E. Reading Comprehension Assessment Using Think Alouds. Located in: 
The Reading Teacher , March 1990, pp. 442-451. 



This article describes an informal assessment process for assessing comprehension It covers 
how to prepare the text, how to administer the think-aloud procedure, and what to look for in 
student responses 

(TC# 440.3REACOA) 



Wagner, C. Lyn, Dana R. Brock, and Ann T. Agnew. Developing Literacy Portfolios in 
Teacher Education Courses. Located in: Journal of Reading 37, iMay 1994, 
pp. 668-674. 

The authors implemented portfolios in their language arts methods course to develop 
familiarity with forms of performance assessment student teachers might use in their own 
classes. The authors use portfolios as one way to develop "empowered professionals" — 
teachers who engage in reflective thinking, learn from social interactions with professional 
peers, are informed decisionmakers, and set personal learning goals. 

Student teachers developed "literacy portfolios" — understanding oneself as a language user. 
Criteria for portfolios included such things as breadth of readings, writing samples, evidence 
of reflective thinking, and use of the writing process. The rating form is included. 

Not included are samples of student work nor technical information. 

(TC# 400.3DEVLIP) 



Walker, Barbara J. Diagnostic Teaching of Reading: Techniques for Instruction and 
Assessment, Second Edition, 1992* Available from: Macmillan Publishing Company, 
866 Third Ave., New York, NY 10022. 

This book describes the process of diagnostic teaching — making sophisticated diagnostic 
decisions and identifying appropriate instructional techniques. 

"The process of diagnostic teaching uses instruction to understand how the problem reader 
approaches the reading event. The goal of diagnostic teaching is to identify instructional 
alternatives that create improved reading performance for the problem reader. Instruction is 
viewed as mediating learning, where the teacher focuses on how the learner solves the reading 
problem by gathering data as she teaches. Furthermore, she views reading as an interactive 
process where the reader uses what he knows to interpret what the text says. Therefore, the 
diagnostic teacher uses the student's strengths (knowledge and strategies) to lead the student 
to integrate new information as well as new strategies into his reading repertoire. She then 
assesses reading growth due to her instruction. She bases her decisions regarding the next 
steps in a student's instruction on this assessment as well as on reflection on the success she 
has achieved by the adjustments she has made. These decisions become increasingly more 
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refined as the diagnostic teacher considers the reading event, evaluates the strategies of the 
problem reader, and matches those with appropriate techniques." 

Diagnostic techniques include miscue analysis, informal reading inventories, retelling, and 
think alouds. These are analyzed for the source of the problem, e.g., print processing, hearing 
processing, or reading strategies. 

(TC# 440.6DIATER) 

W eiss, Barbara. California's New English — Language Arts Assessment^ 1994. Located in: 
Sheila W. Valencia, Elfrieda H. Hiebert, and Peter P. Afflerbach (Eds.), Authentic 
Reading Assessment: Practices and Possibilities , 1994, pp. 197-217. 

This paper adds detail to other entries regarding California's reading assessment procedure in 
grades 4, 8, and 10. In addition to the first part of the assessment, in which students read an 
extended text and respond to several open-ended questions, there are two other parts: group 
work and extended writing. The group work extends students' experience of the text and 
initiates prewriting activities for the subsequent writing assessment. Writing is assessed on 
two traits — conventions and rhetorical effectiveness. Group work is not scored. 

(TC# 440.3CALNEE) 



White, Jane. Taxonomy of Reading Behaviors. Located in: W.T. Fagan, J.M. Jensen, and 
C.R. Cooper (Eds.), Measures for Research and Evaluation in the English Language 
Arts 2, 1985, pp. 120-124. Available from: National Council of Teachers of English 
(NCTE), 1111 Kenyon Rd., Urbana IL 61801, (217) 328-3870. 

The author presents a classification system (originally published in 1980) for analyzing the 
verbal responses of students after reading a short passage. The classifications include 
paraphrasing, statements of trouble understanding what was read, statements that indicate 
what reading strategies the student was using, off-task statements, etc. 

(TC# 440.3TAXOFR) 



White, Sheida, and Barbara Kapinus. 1994 NAEP Assessment in Reading. Located in: 
Focus on NAEP 1, January 1994, pp. 1-5. Available from: National Center for 
Education Statistics (NCES), Education Assessment Division, 555 New Jersey Ave NW, 
Washington, DC 20208, (301) 763-1968. 

This document provides a good, quick overview of the 1994 NAEP reading assessment. The 
assessment includes longer, intact passages of three types — stories, information, and 
instructions. Students can also select one additional passage. It includes a mixture of multiple 
choice, short constructed response, and extended response questions that focus on student 
ability to understand what was written, develop an interpretation, develop a personal 
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response, and critically analyze the text The document includes definitions of the various 
types of reading and student responses, and outlines the time devoted to each type of 
question. 

(TC# 440.3NAEASR) 



Winograd, Peter. Developing Alternative Assessments: Six Problems Worth Solving. 
Located in: The Readine Teacher 47, February 1994, pp. 420-423. 

The author discusses six issues in alternative assessments that, if solved, would enable us to 
truly assess student reading. 

• Clarifying the goals of assessment — what de we want to measure 0 

• Clarifying the audiences to be addressed — students, teachers, parents, administrators, 
legislators.... The author proposes that assessment should first serve teachers and students. 

• Selecting and developing assessment techniques 

• Setting standards of student performance 

• Establishing methods of management. 

• Integratin 5 assessment and instruction — aligning assessment with what is taught, 
embedding assessment in instruction, gathering "evidence" from daily instructional 
activities, and using this information to guide future instruction. 

(TO 440.6DEVALA) 



Winograd, Peter, Scott Paris, and Connie Bridge. Improving the Assessment of Literacy. 
Located in: The Reading Teacher 45, 1991, pp. 108-116. 

The authors present reasons why multiple-choice tests of comprehension based on short 
passages do not adequately reflect what we know about reading, they take reading out of its 
inherent meaning context, test skills in isolation, ignore prior knowledge, and don't look at 
strategies. T hus, instruction is focused on the wrong targets. 

To improve assessment, the authors propose that we need to: clarify the goals of instruction, 
clarify the purposes of assessment, select multiple measures, and use the results to improve 
instruction. The authors then apply these steps to reading assessment. They first present 
three goals in reading: skills that enable students to understand (decoding, interpreting), 
motivation to be active learners, and independence (selecting and using strategies appropriate 
for different contexts). Then they discuss the assessment needs of five audiences and discuss 
multiple measures that could be used to satisfy these needs. For example, students need 
information so that they can become adept at monitoring their comprehension. Information 
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collection devices could include, audiotapes or oral reading, running records, interviews on 
progress, and lists of books read 

(TC# 440.6IMPASL) 

VVixson, Karen K., Anita B. Bosky, Nina Yochum, et al. An Interview For Assessing 

Students' Perceptions of Classroom Reading Tasks* Located in: The Reading Teacher , 
January 1984, pp, 347-353. 

The Reading Comprehension Interview (RCT) has 15 open-ended questions that explore: 

1 . The student's perception of the goal/purpose of reading activities. 

2. The student's understanding of different reading task requirements. 

3 The strategies which the reader reports using when engaging in various reading tasks. 
(TC# 44(\3ANJNTF) 
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CKGahagan (To 400 .m>ropri> 



CSGiliet (TO440 61-NDRPR) 
C8R0S\\ell (TO 440 6CRESI R) 
C9PccrS (TO400.6TF.AREE> 
D 1 Bcmbridge (TO 440 3MAPREA) 
D iEedS (TC* 440 3H0LASC ) 

D iGlazer rro 44o <>reareD) 
DIGnflin <T04oo 3Engprh> 
DIMeltzer fromo 3sirofpi 
D i Morrow cro 440 3retstdi 
D 1 Peterson <to 440 sdevonT) 
D 1 Polakowski (To 440.3LITPOC) 
DlPonland Pub. Sch. iTO 440 3RE.vasri 

D 1 Roswell (TC* 440 6CRESIR) 
D 1 Roswell (TC= 440.3DARTTS ) 

Dl Walker (TO 440.6DIATER) 
D2Bembridge (TC* 440.3MAPREA) 

D2Bishop (TO 440.3ONCCRA) 

D2CA Assess. Prog. (TO 440 3S avienld 
D2CA DOE (TO ooo 6STI/STS) 
D2Clark <to440.3.-vssfrr) 
D2DeFabio (To 400 3CHASTP) 
D2Fagan (TO 430.IME.AREE2) 
D2Farr (TC* 400.3L,vn,vrP) 
D2Glazer (To 400.6PORBEV) 
D2Glazer (TO 440.6RE.-VRED) 
D2Goodman (TO 400.6WHOk.vo 
D2Goodman rrc* 44o.3RE.amid 

D2Griffin (TO400 3ENGPRH) 

D2Hill (TO 000 6PRA.VSA) 

D2Hug (TO400.3BALASI) 

D2IL St. Bd Of Ed. (T0 440 31LLGOR2) 

D2Kinuey <to 440 6INFIN.a) 
D2Klctzien iTO 440.3DVN.VSF) 

D2Knight (TO 440.3CODJOE) 
D2L0Ck (T0 440.3PREEVO) 

D2MA Ed. Assess. Prog. (TO 440.3ONTHEOrj 

D2McTighe (TO 400 3MDRWLA) 

D2Meltzer (TO oio.3SfROFP) 

D2MD St. DOE (TO 440 3MARSCP0 

D2Morrow (TC* 440.3 retstdj 
D2Mossenson (TO 440 3TORCHT) 

D20R DOE (TC* 440.3OREOPE) 

D2Paratore (TO 440 sintaso 

D2PhillipS (TO 440.3DE WAV) 
D2PhillipS (TO 440.3TESINA) 
D2Pikulski (TC* 440 11NFREI2) 

D2Peterson (TO 440.3DEVONT) 
D2Portland Pub. Sch. (TO 440 jrea.\sR) 

D2Pr0V. Of BC (TO070.3SrPLEl) 
D2Ps>ch. Corp. (TO 440.3GOALSr) 

D2Rhodes rro 400.3LIT.ash) 

D2R0SWCli (TO 440 6CRESl*R) 
D2R0SWell (TC* 440 3D.ARTTS) 

D2Roycr (TO440 6SKNVET) 
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D2Sammons < tc 44o ivsssttj 
D2Shannon «tc- 44o msimif« 
D2Touchstonc t re* 440 jdf.goiri 
D2VaIcucia rrc* 440 othf.anpj 
D2Wade rrc-- 440 3REAcoa» 
D2\Valkcr rrc-' 440 6DIailrj 

D2WdSS (TC- 440 3C.UNEE) 
D2\VhltC (TC' 1 .' 440 3N.U-..VSR) 

D3Bcan <tc-- 440 60Rgreh 

D3BrO\\n (TC- 440.6MER.ASh 
D >CA DOE iTC* 000 6STI STS) 
D3Clay (TC- 440.3CONABP) 

D^Gla/er n - c* 440 6REARED) 
D3Goodman rrc= 400 6\vholao 
D3Goodman (TC*440.3RE,vmU) 

D3Griffin (TC*400.3ENGPRH) 

D3IL St. Bd. of Ed. (TC=440.31U.GOR2) 

D3Kletzien (TC* 440.3DVN.-VSF) 
D3 Knight (TC* 440.3CODJOE) 

D3Lidz (TC- 000.3PRAGIT)) 
D3L0Ck (TC" 440.3PREEVO) 

D3MA Ed. Assess. Prog. (TC-440 30NTHEOM 

D3McTighe (TC* 400.3MDRWLA) 

D3Meltzer (TC- 010.3 st'ROFP) 

D3McyerS (TC* 440.3THIALP) 
D3MorrO\V (TC" 440 3RETSTD) 

D3Paratore (TO 440.31NTASO) 
D3Portland Pub. Sch. (TO440 3REAASR) 
D3Rhodes (TO 40o.3UTASH) 

D3R0S\Vell (TC* 440.6CRESCR) 
D3Schmitt (TC* 440 3METSTI) 

D3 Valencia (TC* 440 6THEANP) 
D 3 Walker (TC* 440.6DUTER) 

D3\VeiSS (TO 440.3C.UNEF) 

D3Wixson ere- 440 3,v\intf) 

D4Bishop (TC- 440 30NCIRA) 

D4CA DOE O'oooo 6STl"STS) 
D4DeFabio (TO 400 3CH.\STP) 
D4Griffin (TO4U0.3ENGPRH) 

D4Shannon (TO 440.31'SIMIE) 
D5Fagan <tc* 430 1MEAREE2) 

DSHlll (TC-000.6PR.VVS A) 

D5McKcnna (T0 440.3ME.vtoR) 

D5PetCrSOn (TC* 440.3DEVONT) 

D5Portland Pub. Sch. (TO 440.3RE.v\SR) 

D5RhodCS (TC- 400.3LITASH) 

D5Shannon <To 440.31'SIMIE) 
D5Valencia (TO 440 6THEANP) 

DGBishop (TC» 440.3ONCVRA) 

DGDeFabio (TO 400 3CH/\STP) 
DGPortland Pub, Sch. (TO 44o.3RE.vvmo 

D7BrO\vn (TC* 440.6MERASI) 

D7MeIt/er (TO 010 JSl'ROFP) 
D7Shannon (TO 440 usiMih) 



DHClay (TO 440 3CON.VBP) 
DSEeds (TC- 440 WOI.ASO 
D8GiIlet (TO440 6l'NDRPRi 

DSGoodman (TC- 400 eAVHOLACi 
D8Polako\vski no 440 3UTPt)C» 
D8Portland Pub. Sch. (TO440.3RE.\asrj 
D9DeFabio (TO 400.3CH.vstp) 
D9Fagan cro 430 ime.\ree2) 
DIOEberhart (TC*qoo.3SECpr,u 
DlOFarr (TC* 400 3L,v\,vRP) 
D lOMcTighe (To 400 3MDR\vi,a» 
D lOSammons (TC* 440.2.\sssm 
D 1 lGlazer (TO 400 6PORBEV) 
Dl 1 Goodman no 400 6wholac> 
D 1 2Goodman (TC* 440.3REA.uih 

D12IL St. Bd. Of Ed. (T0 440.31LLGOR2) 

D12Kinney (TC* 440.6INFINA) 

D 1 2L0Ck (TC* 440.3PREEVO) 

Dl2McTighe (TC* 400.3 MDRWLA) 
D 13 Allen (TC* 300.3OR.acod 
D13CA DOE (TC* 000.6STVSTS) 
D13DeFabio (To 400.3ch.vstp) 

D13Griffin (TO400 3ENGPRH) 
D 1 3Hug (TO 400.3B.UASl) 
D130R DOE (TC* 440.3OREOPE) 

D 1 3Peterson no 440.3DEVONT) 
D 1 3Thistleth\vaite (TO 440.3CRIREA) 

D13WeisS (TC* 440.3CUNEE) 

D 13 White (TC* 440.3NAEASR) 

E1CA DOE (TC* 000.6STVSTS) 

E11L St. Bd. of Ed. (TC*440.3ILLGOR2) 

ElKlCtzien (TO440.3DYN.VSF) 
El Lock (TC* 440.3PREEVO) 
EIROSWCII (TC* 440.3DARTTS) 

ElRo\er (TC*44o.6SENVE'n 
El Valencia (TC* 440.6THEANP) 

El White (TO 440 3N.U.VSR) 

E2CA DOE (TC* 000.6STVSTS) 
E2Clay (TC»440.3con.vbp) 
E2CTB/McGra\v-Hill (TO 400 3CTBREL) 
E2Fagan (TC* 430.1MEAREE2) 

E2Farr (TC* 440.6PLT.ut) 

E2Hug (TC* 400.3BU.VSI) 
E2KY DOE (TC* 060 3 KEN IN R) 

E2MA Ed. Assess. Prog. (TC*440.3ONTHE()r) 
E2McTighe (TC* 400.3MDRWLA) 
E2MD St. DOE (TC* 440.3 MAR SCPr) 

E2Meltzcr (TC* oiojsrROFP) 
E2Phillips ere* 440 3DEvvaaj 

E2PhillipS (TO 440.3TESINA) 
E2Pikulski (TO 440.UNFREI2) 
E2PSVCh. Corp. (TO 440.3GOU.Sr) 

E2Riverside Pub. Co. (TO 060 3PERAST) 

E2R0S\VCll (TC* 440 3DAR V\ S) 
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E2\Valkcr rro 440 gdiateRj 

E2 White <Tc-= 44u jnaeasRi 

E >CA DOE iTc- ooo esTrsrs, 

E3CTB/\lcGra\\-Hill <tc- 4;.-o 3CTHRi-.i.» 

E3Hug iTC" 400 3BAI.ASI) 

E^KY DOE ( IC" 060 3 KEN IN R» 

E3MA Ed Assess. Prog, rrc* 44o 3(>NTiiKOn 

E30R DOE , IC- 44u 30REOPI- ) 
E3PctCrS0n ( TC" 440 3DEVONT) 

E3Riversidc Pub. Co. <tc»060 3PERasTi 

E? White <TO 440 3NAEASR) 
E4A11CI1 (TC= 300 30RACOD 

E4Bcan (TC-- 440 60RGRED 
E4Bcmbridgc (TO- 440 3MAPREA) 
E4CA Assess. Prog. <TC« 440 3S.VMENL.n 
E4CA DOE (TC - ooo 6s n stsj 

E4Clark (TC = 440.3ASSFRR) 

E4CTB/McGra\\-Hill <TC= 400 3CTBRFU 
E4Fagan <tc= 430 imearee:> 
E4Farr (TC-* 400.3LANARP) 
E4Farr (TC= 440.6PITALT) 

E4Hug (TC* 400.3BALASI) 

E4Larter <tc= 100 6BENCHM) 

E40R DOE (TC= 440.3OREOPE) 

E4Peers crc= 400.6TEAREE) 
E4Peterson (TC= 440 3DEVONT) 
E4Walkcr ere-.- 440 6DIater> 

E4WC1SS (TC» 440.3CALNEE) 
E4WhitC HC- 440 3N.VEASR) 
E5A11CI1 (TC= 300 30RACOL) 

E5Eberhart nc- ooo.3SECPR.vi 
E6Allcn (TCs 300 30RACOI.) 
EGBarton ere- 130 4Porti:e> 
E6Bcllingham Pub. Sch. (TO ooo.3BEL.Prs) 
E6Bishop (TCs 440 30NCIRA) 
E6CA DOE fTC- 000.6STI STS) 

E6C<'ilfcc (TC* 440.6STTPOO) 

E6Clcmmons ere- 400 3P0RCLT) 
E6DcFabio iTC= 400 3CHASTP) 

E6Fingcrct (TC- 440.3ITBM.M) 
E6Flood (TC- 400 3 RE PREP) 
E6Gahagan (Tc= 400 3PROPRD 
EGHanscn (TC= 400.3UTPOH) 
E6Hanscn <TC* 440 6UTPOF) 

E6Hill (TCs 000 6PR,VASA) 
E6Int'lRcad, Assn. <TC»440 6PORlLP) 

E6Polako\\ski <TC« 440.3LITPOC) 

E6Porlland Pub Sch. (TC* 440 3Ri:.VASR> 
EGSalinger crc« 400 oci ab.vp) 
E6Scrrano <tc» 000 3t.ooPOA) 
EGStahlc rrc« no 3POR.vsa 
EdTicrncy (Tc» 4006PORASO 
E6 Valencia (TC« 440 gaporapi 

E7EedS(TC*440 3HOt.ASCi 



E7GillCt (TC=440 61NDRPR) 

E7Goodman iic- 400 6\vhoi aci 
E^Goodman ere- 440 3Ri- amid 
E7Grant <tc= 440 itowtrti 
E7pikulski rrc-440 iinfrei:> 
E7Polako\vski <tc* 440 31.ITPOC1 
E7Rhodes (TC* 40U 3 LIT ASH) 
E7Ros\vell <TC- 440 3DARTTS1 
E7Walkcr (TO- 440 6DI.\teri 
E8CA Assess. Prog. (TC«44o 3SAME\l.n 

E8Cla> (TC= 440.3CON.VBP) 

E8Fagan <tc= 430 imearee2) 
ESMcTighe iTC= 400 3MDRWI.aj 

E8Rea (TC* 440 6DF.STRF) 

E9Bembridge (TC= 440 3MAPRE.U 

E9Clark (TC-- 440.3ASSFRR) 

E9Glazer iTC- 400 6PORBEY) 
E9Glazer <tc= 440.6RE.VRED) 
E9Goodman <tc* 440.3REAMID 
E9Kinney (TC= 440.61NFINA) 
E9Meltzer (TC= oio.3Si'ROFP) 
E9Morro\v <tc» 440.3RETSTD) 
E9Mossenson (TC» 440.3TORCHT) 
E9Polako\vski (TC= 440.3LITPOC) 
E9Portland Pub. Sch. <TC=440.3REAASR) 
E9Walker (TC= 440.6DIATER) 
E lOEberhart <TC« 000.3SECPRA) 
E 1 1 Grant (TC= 440 itowtr d 

El ITouchstone (TC» 440.3DEGOFR) 

E 12 Allen rrc= 300.30RACOD 

E12CA DOE (TC= 400.3CAJLLER2) 

E 1 2Clcmmons <TC- 400 3PORCLT) 

E12Eeds (TC~- 440.3HOL.ASC) 

E 1 2Eggleton (TC= 400 3\vhol.vR) 
E12Glazer (TC= 440.6RE.VRED) 
E12Grant (TC= 440.1 TO WTRT) 

E 12Hill (TC- 000.6PR.AASA) 

E 1 2Kay ere- 440.6thitwm) 
E 1 2Mcllzcr (TC- 0I0.3SIROFP) 
E 12Paratorc (TC* 440.3INT.VSO) 

E 1 2R0SWCll (TC* 440 6CRESIR) 

E12Sammons (TC= 440 2.VSSSTT) 
E12Shannon (Tc« 440.31'SIMIE) 
E 12Taylor <tc= 440.3TEA\vm 
E 12 Walker (TC« 440.6DIATER) 

E12Wi\SOn (TC* 440 3ANINTF) 

E 1 3Bcan <tc« 440.6ORGRED 

E 1 3Bro\\n (TC« 440.6MER.VSI) 

E 1 3Gla/cr (TC« 400.6PORBEV) 

E 13Giazcr <TC» 440.6REARED) 

E 13 Kinney <TC* 440 6 IN FIN A) 
E 13 Meyers <tc* 440 3THULP) 

E 1 3R0SWCll (TC» 440.6CRF.Sl R I 

E 1 3 Wade (Tc» 440 wkacoA) 
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E I > Walker <to 440 6i)i.vn.R ■ 
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Fl Allen iTC» .loo joracoi.i 
Fl Peterson *tc« 440 3DEvon Ti 
Fl Serrano <tc ooo 3LOOPOA) 
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F3 Allen (TC* ?oo 30RACOI.1 
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G1KY DOE (TC- 060.3KENINR) 
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G 1 McTighe {TC« 400.3MDR\vl.A) 
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G 1 Phillips (TC« 440 3DEYY.VA) 
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GIPsych. Corp. (TC- 440 3UOAJ.Sr) 
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G2iMcTighe (TC* 400 3MDRWLA) 
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G3Eberhart (TC» 000 3SECTRA) 
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G30R DOE (TCtf 440 30REOPE) 
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G4Gla/er (Tc« 440 6REARED) 
G4Gnffin (Tt'«4oo 3ENuprid 
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G4Hill (TC> 000 6PRAASA) 
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G5Shannon (TC~ 440.31 simifj 
G5Thistleth\vaite nr~ 440 3CRIRE.u 
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